Jul 11 01:06:01.307983 ip-10-0-143-25 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 01:06:01.848447 ip-10-0-143-25 systemd[1]: Started Kubernetes Kubelet.
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.761578    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768024    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768038    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768042    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768045    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768048    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768051    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:01.888262 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768054    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768058    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768062    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768065    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768069    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768072    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768075    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768078    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768081    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768083    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768086    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768088    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768091    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768095    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768097    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768103    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768106    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768109    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768112    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:01.901587 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768115    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768118    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768120    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768123    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768125    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768128    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768131    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768133    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768136    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768139    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768141    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768143    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768146    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768149    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768151    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768154    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768156    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768159    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768161    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768164    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:01.904180 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768166    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768170    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768173    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768175    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768179    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768188    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768193    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768197    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768199    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768203    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768206    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768209    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768212    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768214    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768217    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768220    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768223    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768226    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768229    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768231    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:01.932665 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768234    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768237    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768239    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768242    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768246    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768250    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768255    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768258    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768261    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768263    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768266    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768269    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768273    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768276    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768279    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768281    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768284    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768287    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768289    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768292    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:02.081767 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768294    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768297    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768300    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768303    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768305    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768308    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768311    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768313    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768316    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768319    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768321    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768324    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768327    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.768330    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770551    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770567    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770572    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770576    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770581    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:02.083281 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770586    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770591    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770596    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770601    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770606    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770616    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770621    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770626    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770631    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770636    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770643    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770650    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770656    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770660    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770665    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770669    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770674    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770695    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770706    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:02.084389 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770710    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770715    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770719    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770723    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770728    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770732    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770736    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770741    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770745    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770750    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770754    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770763    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770772    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770777    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770782    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770786    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770791    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770797    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770802    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770806    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:02.085008 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770811    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770816    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770820    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770829    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770833    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770837    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770841    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770845    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770850    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770854    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770860    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770864    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770869    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770874    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770878    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770887    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770892    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770896    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.770900    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:02.085664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771021    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771045    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771054    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771060    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771066    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771071    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771076    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771087    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771093    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771099    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771103    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771115    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771120    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771125    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771142    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771151    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771267    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771272    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771276    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:02.086256 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771281    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771284    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771286    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771292    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771294    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771297    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771300    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771303    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771306    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771308    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771311    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771313    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771316    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771319    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771322    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771325    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771327    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771746    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771752    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771755    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:02.086899 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771758    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771761    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771764    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771766    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771769    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771773    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771775    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771778    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771781    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771783    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771786    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771788    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771791    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771794    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771797    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771801    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771804    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771806    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771809    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771812    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:02.087470 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771814    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771817    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771819    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771822    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771825    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771828    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771830    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771833    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771837    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771841    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771844    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771846    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771849    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771851    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771854    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771856    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771859    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771861    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771865    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:02.088146 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771869    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771873    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771877    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771880    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771883    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771886    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771888    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771891    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771895    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771897    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771900    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771903    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771906    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771908    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771910    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771913    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771915    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771919    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771921    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:02.088773 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771924    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771926    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771929    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771932    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771936    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771939    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771941    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771944    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771947    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771950    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771952    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771955    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771957    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771960    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771962    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771965    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771967    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771970    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771972    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771975    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:02.089324 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771977    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771982    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771985    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771987    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771990    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771993    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771996    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.771999    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772001    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772004    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772006    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772009    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772012    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772014    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772017    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772019    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772023    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772025    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772096    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772104    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772110    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 01:06:02.089915 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772114    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772118    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772121    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772125    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772129    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772132    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772135    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772139    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772142    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772145    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772148    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772151    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772155    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772158    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772162    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772166    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772168    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772171    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772174    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772177    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772188    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772192    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772195    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 01:06:02.090494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772198    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772201    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772204    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772207    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772214    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772217    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772221    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772224    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772227    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772229    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772233    2563 flags.go:64] FLAG: --enable-server="true"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772235    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772240    2563 flags.go:64] FLAG: --event-burst="100"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772243    2563 flags.go:64] FLAG: --event-qps="50"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772246    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772249    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772252    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772256    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772258    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772261    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772264    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772269    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772271    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772276    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772279    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 01:06:02.091105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772282    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772285    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772288    2563 flags.go:64] FLAG: --feature-gates=""
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772292    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772295    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772298    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772301    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772304    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772308    2563 flags.go:64] FLAG: --help="false"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772311    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772314    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772319    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772322    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772325    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772328    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772331    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772334    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772336    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772339    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772342    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772345    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772348    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772351    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772353    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 01:06:02.091818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772357    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772360    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772362    2563 flags.go:64] FLAG: --lock-file=""
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772365    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772370    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772373    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772378    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772382    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772384    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772387    2563 flags.go:64] FLAG: --logging-format="text"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772390    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772393    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772396    2563 flags.go:64] FLAG: --manifest-url=""
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772399    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772403    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772406    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772410    2563 flags.go:64] FLAG: --max-pods="110"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772413    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772416    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772421    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772424    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772427    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772430    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772433    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772439    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 01:06:02.092762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772442    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772445    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772448    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772451    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772456    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772459    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772462    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772465    2563 flags.go:64] FLAG: --port="10250"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772468    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772470    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06062107c85948662"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772474    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772477    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772481    2563 flags.go:64] FLAG: --register-node="true"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772483    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772487    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772494    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772497    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772500    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772504    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772507    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772510    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772513    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772516    2563 flags.go:64] FLAG: --runonce="false"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772518    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772521    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 01:06:02.093508 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772524    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772529    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772531    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772534    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772537    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772540    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772543    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772546    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772549    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772551    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772554    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772557    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772560    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772565    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772568    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772570    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772574    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772577    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772580    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772584    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772587    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772590    2563 flags.go:64] FLAG: --v="2"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772593    2563 flags.go:64] FLAG: --version="false"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772603    2563 flags.go:64] FLAG: --vmodule=""
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772607    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 01:06:02.227781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.772610    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772743    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772748    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772751    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772754    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772756    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772759    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772762    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772766    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772769    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772771    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772774    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772776    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772779    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772782    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772786    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772790    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772794    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772796    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:02.228664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772800    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772802    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772805    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772808    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772810    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772813    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772815    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772819    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772822    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772824    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772827    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772830    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772838    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772841    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772843    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772846    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772865    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772869    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772872    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772875    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:02.229261 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772878    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772882    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772885    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772887    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772890    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772893    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772897    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772901    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772903    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772906    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772908    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772911    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772913    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772916    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772918    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772921    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772924    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772926    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772929    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772933    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:02.229859 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772936    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772939    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772941    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772944    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772946    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772949    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772952    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772954    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772957    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772959    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772963    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772967    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772970    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772974    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772976    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772980    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772982    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772985    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772987    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:02.230402 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772990    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772992    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772995    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.772998    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773001    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773003    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773005    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773008    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773011    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773014    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773016    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773018    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773022    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773024    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773027    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773029    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773032    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773034    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773037    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773040    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:02.231002 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773042    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.773045    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.773714    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.780768    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.780783    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.780807    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.780816    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780869    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780873    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780877    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780880    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780883    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780886    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780889    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780892    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:02.231522 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780895    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780898    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780900    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780903    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780905    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780908    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780911    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780913    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780916    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780918    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780921    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780924    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780927    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780930    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780932    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780935    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780939    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780942    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780945    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:02.232028 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780949    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780953    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780959    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780962    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780965    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780967    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780970    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780974    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780978    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780981    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780984    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780987    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780990    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780992    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780996    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.780998    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781001    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781006    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781008    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:02.232544 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781011    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781014    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781017    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781020    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781022    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781025    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781027    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781030    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781032    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781035    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781038    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781041    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781044    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781047    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781049    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781053    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781056    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781058    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781061    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781064    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:02.233100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781066    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781069    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781071    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781074    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781077    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781080    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781082    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781084    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781087    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781090    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781094    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781096    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781100    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781102    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781105    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781107    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781110    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781112    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781115    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781118    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:02.233675 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781121    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781123    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781125    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781128    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781137    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781140    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781142    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781146    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781149    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781152    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781154    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781157    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781159    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.781164    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781274    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:02.234270 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781279    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781281    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781284    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781288    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781290    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781293    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781296    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781300    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781302    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781305    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781308    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781310    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781313    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781315    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781318    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781320    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781323    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781325    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781328    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781330    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:02.234717 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781333    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781335    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781339    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781341    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781344    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781348    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781351    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781353    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781356    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781358    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781361    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781364    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781366    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781369    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781371    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781373    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781376    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781378    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781381    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781385    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:02.235280 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781388    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781390    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781393    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781396    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781399    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781401    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781403    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781406    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781409    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781412    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781414    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781417    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781421    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781425    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781428    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781433    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781436    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781440    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781443    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:02.235815 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781445    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781448    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781450    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781453    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781456    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781458    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781461    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781465    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781468    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781470    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781473    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781476    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781479    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781482    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781484    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781487    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781489    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781492    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781494    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:02.236357 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781497    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781499    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781502    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781504    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781507    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781509    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781512    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781515    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781517    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781519    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781524    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781529    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781532    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781535    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781538    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781541    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781544    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781546    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781549    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:02.236926 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:01.781551    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.781556    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.781660    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.783913    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.785609    2563 server.go:1019] "Starting client certificate rotation"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.785710    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.785748    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.788552    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.789657    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.805932    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.808330    2563 log.go:25] "Validated CRI v1 image API"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.809190    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 01:06:02.237459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.815101    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b34e0ef2-775c-42a6-bc2b-5113ece66ba4:/dev/nvme0n1p4 dd91603d-6a23-41cb-85b7-5914279a44cc:/dev/nvme0n1p3]
Jul 11 01:06:02.237828 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.815117    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 01:06:02.237828 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.817405    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.823453    2563 manager.go:216] Machine: {Timestamp:2026-07-11 01:06:01.821989821 +0000 UTC m=+0.375225721 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099207 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b15f452cf5b798ade4fe98675525f SystemUUID:ec2b15f4-52cf-5b79-8ade-4fe98675525f BootID:be2d28db-a6ef-454d-81ff-93b845c19442 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:d3:0b:86:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:d3:0b:86:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:f0:24:39:ac:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.823554    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.823636    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.827173    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.827199    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.828036    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.828046    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.828053    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.828068    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.829887    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833117    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833227    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833255    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833264    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833278    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833287    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833297    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 01:06:02.238289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833619    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.833633    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.837003    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839336    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839363    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839520    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839533    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839539    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839545    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839560    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.839566    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.840094    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.840100    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.840107    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.840112    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.840128    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.840136    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.841829    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.841836    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.845975    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.846156    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.847272    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.847499    2563 server.go:1268] "Started kubelet"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.847572    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.847650    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.847705    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.849135    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.850251    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.851971    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-25.ec2.internal.18c116c4c86b5cbb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-25.ec2.internal,UID:ip-10-0-143-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-25.ec2.internal,},FirstTimestamp:2026-07-11 01:06:01.847307451 +0000 UTC m=+0.400543352,LastTimestamp:2026-07-11 01:06:01.847307451 +0000 UTC m=+0.400543352,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-25.ec2.internal,}"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.853820    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.856993    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.857000    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.857414    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858330    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858342    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858366    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858437    2563 factory.go:55] Registering systemd factory
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858455    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858454    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858489    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858820    2563 factory.go:153] Registering CRI-O factory
Jul 11 01:06:02.371342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858834    2563 factory.go:223] Registration of the crio container factory successfully
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858883    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858881    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lxkq2"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858905    2563 factory.go:103] Registering Raw factory
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.858928    2563 manager.go:1196] Started watching for new ooms in manager
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.859316    2563 manager.go:349] Starting recovery of all containers
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.866211    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lxkq2"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.866401    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.867963    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.868073    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.871194    2563 manager.go:354] Recovery completed
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.875061    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.880579    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.880605    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.880614    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.881140    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.881149    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.881159    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.881164    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.881838    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.881866    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.881878    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.882284    2563 policy_none.go:49] "None policy: Start"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.882297    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.882307    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.883367    2563 policy_none.go:47] "Start"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.955234    2563 manager.go:337] "Starting Device Plugin manager"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.955264    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.955275    2563 server.go:87] "Starting device plugin registration server"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.955554    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.955567    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.955704    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.955791    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:01.955800    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.956233    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:01.956284    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.048910    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.048951    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.048975    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.049010    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.051401    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.056340    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.059512    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.059539    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.059548    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.059579    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.379597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.068696    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.068719    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-25.ec2.internal\": node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.088036    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.150109    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal"]
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.150215    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.152011    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.152045    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.152058    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.153533    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.153637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.153665    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.154273    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.154302    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.154313    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.154273    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.154373    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.154387    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.155460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.155482    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.156100    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.156125    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.156134    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.159221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a343a858d6edb11abb86474c850c3d4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal\" (UID: \"a343a858d6edb11abb86474c850c3d4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.159242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a343a858d6edb11abb86474c850c3d4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal\" (UID: \"a343a858d6edb11abb86474c850c3d4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.159260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b15c5c2738510537812bfa649878a461-config\") pod \"kube-apiserver-proxy-ip-10-0-143-25.ec2.internal\" (UID: \"b15c5c2738510537812bfa649878a461\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.183235    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-25.ec2.internal\" not found" node="ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.188233    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.191224    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-25.ec2.internal\" not found" node="ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.260167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a343a858d6edb11abb86474c850c3d4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal\" (UID: \"a343a858d6edb11abb86474c850c3d4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.381431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.260206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a343a858d6edb11abb86474c850c3d4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal\" (UID: \"a343a858d6edb11abb86474c850c3d4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.382560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.260223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b15c5c2738510537812bfa649878a461-config\") pod \"kube-apiserver-proxy-ip-10-0-143-25.ec2.internal\" (UID: \"b15c5c2738510537812bfa649878a461\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.382560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.260246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a343a858d6edb11abb86474c850c3d4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal\" (UID: \"a343a858d6edb11abb86474c850c3d4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.382560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.260280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b15c5c2738510537812bfa649878a461-config\") pod \"kube-apiserver-proxy-ip-10-0-143-25.ec2.internal\" (UID: \"b15c5c2738510537812bfa649878a461\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.382560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.260280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a343a858d6edb11abb86474c850c3d4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal\" (UID: \"a343a858d6edb11abb86474c850c3d4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.382560 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.288867    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.581613 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.389353    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.581613 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.485354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.581613 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.489642    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.581613 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.494816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:02.818560 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.590726    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.818560 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.691536    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.818560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.784426    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 01:06:02.818560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.784611    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 01:06:02.818560 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.791609    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:02.818560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.798412    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:03.045031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.852211    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:03.045031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.870474    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 01:01:02 +0000 UTC" deadline="2028-04-16 06:23:42.740878106 +0000 UTC"
Jul 11 01:06:03.045031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:02.870500    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15485h17m39.870380668s"
Jul 11 01:06:03.045031 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.891766    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:03.045031 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:02.992904    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:03.194737 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.093471    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:03.194737 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:03.145625    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15c5c2738510537812bfa649878a461.slice/crio-7b22fdc0a7948a8f1c3eb0fc9017f6443aff2c7838328722e46bcf4cff0f370c WatchSource:0}: Error finding container 7b22fdc0a7948a8f1c3eb0fc9017f6443aff2c7838328722e46bcf4cff0f370c: Status 404 returned error can't find the container with id 7b22fdc0a7948a8f1c3eb0fc9017f6443aff2c7838328722e46bcf4cff0f370c
Jul 11 01:06:03.194737 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:03.146075    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda343a858d6edb11abb86474c850c3d4f.slice/crio-15a95a7b6b87f59db5f591c596fce76a91d103083ce3427961091254a33d4957 WatchSource:0}: Error finding container 15a95a7b6b87f59db5f591c596fce76a91d103083ce3427961091254a33d4957: Status 404 returned error can't find the container with id 15a95a7b6b87f59db5f591c596fce76a91d103083ce3427961091254a33d4957
Jul 11 01:06:03.194737 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.150956    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:06:03.194737 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.194052    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-25.ec2.internal\" not found"
Jul 11 01:06:03.422716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.251525    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:03.422716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.257546    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:03.422716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.269966    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 01:06:03.422716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.271211    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal"
Jul 11 01:06:03.422716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.279042    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.834439    2563 apiserver.go:52] "Watching apiserver"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.844324    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.852264    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-c7glx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct","openshift-multus/network-metrics-daemon-fd7vb","openshift-network-diagnostics/network-check-target-h42zv","openshift-network-operator/iptables-alerter-l77pg","openshift-ovn-kubernetes/ovnkube-node-qhfzq","kube-system/global-pull-secret-syncer-xrbwz","kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wrfsb","openshift-dns/node-resolver-wd5tt","openshift-image-registry/node-ca-2zwrd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal","openshift-multus/multus-additional-cni-plugins-gql64","openshift-multus/multus-xh8rr"]
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.853965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.854053    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.855195    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.856587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.856931    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.857446    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.857661    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.857853    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.858113    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.858276    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.858317    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2zs79\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.858326    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.860193    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.860270    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.862351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.863988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.864655    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.864740    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.864852    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.865407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.865586    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6hl4q\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.866543    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.866546    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.866598    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.866653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.866717    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 01:06:03.869197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.866823    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.866963    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h7h8z\""
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.867028    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.868127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.868190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.868208    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j592\""
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.868527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.868921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-system-cni-dir\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.868951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.868977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99pnv\" (UniqueName: \"kubernetes.io/projected/ad78a13b-e32c-49aa-887e-dee668138a07-kube-api-access-99pnv\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-cnibin\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-os-release\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b28a717-7879-4ddb-8af2-c781fd0dab18-dbus\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s8n5\" (UniqueName: \"kubernetes.io/projected/f7bda9e9-6737-4a81-8098-6a53c753a915-kube-api-access-4s8n5\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-cni-binary-copy\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.871036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.869370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b28a717-7879-4ddb-8af2-c781fd0dab18-kubelet-config\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.870690    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p9hbf\""
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.870805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.870850    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.870926    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.871095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4826t\""
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.871111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.871133    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.871112    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 01:06:03.872420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.871659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873227    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873487    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mqhg2\""
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873869    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wdfx6\""
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873883    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873957    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 01:06:03.874239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.873959    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 01:06:03.875597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.874998    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 01:06:03.875597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.875433    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 01:06:03.876737 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.875754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v7w8h\""
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.896202    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjz8c"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.903995    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjz8c"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.959485    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.969744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-log-socket\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.969803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-registration-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.969857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-hostroot\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.969919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-multus-certs\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.969940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-etc-kubernetes\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.969972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s8n5\" (UniqueName: \"kubernetes.io/projected/f7bda9e9-6737-4a81-8098-6a53c753a915-kube-api-access-4s8n5\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.970002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-systemd-units\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.970025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-ovnkube-config\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.970047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-systemd\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.970151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.970624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.971314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-cni-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.971555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ckd\" (UniqueName: \"kubernetes.io/projected/c48792bf-a6ea-4f49-b549-8df6c12261bb-kube-api-access-l4ckd\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:03.976443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-cni-bin\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysctl-d\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-host\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b5eac27-a01d-4a36-8e88-76931231023d-tmp\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b28a717-7879-4ddb-8af2-c781fd0dab18-dbus\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-env-overrides\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-daemon-config\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-kubelet\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.978047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b28a717-7879-4ddb-8af2-c781fd0dab18-dbus\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.972702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-run-netns\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.984919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.984947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-cnibin\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.984970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-netns\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.984995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-conf-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-sys\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-cni-binary-copy\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aace16b5-8518-46a8-a6fc-96756245cb15-serviceca\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-system-cni-dir\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbrrd\" (UniqueName: \"kubernetes.io/projected/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-kube-api-access-jbrrd\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:03.985153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.986080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-system-cni-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.986080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysconfig\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.986080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-cni-binary-copy\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.985227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aace16b5-8518-46a8-a6fc-96756245cb15-host\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-cnibin\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-os-release\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-system-cni-dir\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-hosts-file\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-var-lib-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-device-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-cnibin\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-kubelet\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-cni-binary-copy\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-os-release\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-node-log\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.987669    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-cni-netd\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.989615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e399d95-1611-4952-aa0b-87587d7759d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.987745    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret podName:3b28a717-7879-4ddb-8af2-c781fd0dab18 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:04.487716292 +0000 UTC m=+3.040952181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret") pod "global-pull-secret-syncer-xrbwz" (UID: "3b28a717-7879-4ddb-8af2-c781fd0dab18") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c48792bf-a6ea-4f49-b549-8df6c12261bb-host-slash\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-modprobe-d\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.987848    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.987867    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.987880    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5xfll for pod openshift-network-diagnostics/network-check-target-h42zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-kubernetes\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.987983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b28a717-7879-4ddb-8af2-c781fd0dab18-kubelet-config\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.988028    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll podName:022292b2-96b6-40f2-9663-f6f9304a7f0c nodeName:}" failed. No retries permitted until 2026-07-11 01:06:04.488011622 +0000 UTC m=+3.041247510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5xfll" (UniqueName: "kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll") pod "network-check-target-h42zv" (UID: "022292b2-96b6-40f2-9663-f6f9304a7f0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-ovnkube-script-lib\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-cni-bin\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b28a717-7879-4ddb-8af2-c781fd0dab18-kubelet-config\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysctl-conf\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.990742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7bda9e9-6737-4a81-8098-6a53c753a915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-var-lib-kubelet\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b5eac27-a01d-4a36-8e88-76931231023d-etc-tuned\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-etc-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-socket-dir-parent\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-cni-multus\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-systemd\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8aba721-3554-4bc3-b242-0f8dde0ef77a-agent-certs\") pod \"konnectivity-agent-c7glx\" (UID: \"c8aba721-3554-4bc3-b242-0f8dde0ef77a\") " pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8aba721-3554-4bc3-b242-0f8dde0ef77a-konnectivity-ca\") pod \"konnectivity-agent-c7glx\" (UID: \"c8aba721-3554-4bc3-b242-0f8dde0ef77a\") " pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh2sq\" (UniqueName: \"kubernetes.io/projected/0e399d95-1611-4952-aa0b-87587d7759d0-kube-api-access-zh2sq\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-socket-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxn9h\" (UniqueName: \"kubernetes.io/projected/aace16b5-8518-46a8-a6fc-96756245cb15-kube-api-access-vxn9h\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-lib-modules\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-slash\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.991677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxqgk\" (UniqueName: \"kubernetes.io/projected/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-kube-api-access-kxqgk\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c48792bf-a6ea-4f49-b549-8df6c12261bb-iptables-alerter-script\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-ovn\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7bda9e9-6737-4a81-8098-6a53c753a915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h49tp\" (UniqueName: \"kubernetes.io/projected/f4a282d5-6e03-4d74-a825-61a8608032ef-kube-api-access-h49tp\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.988850    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-run\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99pnv\" (UniqueName: \"kubernetes.io/projected/ad78a13b-e32c-49aa-887e-dee668138a07-kube-api-access-99pnv\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-tmp-dir\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:03.988948    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:04.488929324 +0000 UTC m=+3.042165225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.988983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-k8s-cni-cncf-io\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.989013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwzt2\" (UniqueName: \"kubernetes.io/projected/6b5eac27-a01d-4a36-8e88-76931231023d-kube-api-access-fwzt2\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.989048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-sys-fs\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.989075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-os-release\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.989571    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 01:06:03.993276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:03.993262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s8n5\" (UniqueName: \"kubernetes.io/projected/f7bda9e9-6737-4a81-8098-6a53c753a915-kube-api-access-4s8n5\") pod \"multus-additional-cni-plugins-gql64\" (UID: \"f7bda9e9-6737-4a81-8098-6a53c753a915\") " pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.000629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99pnv\" (UniqueName: \"kubernetes.io/projected/ad78a13b-e32c-49aa-887e-dee668138a07-kube-api-access-99pnv\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.068196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal" event={"ID":"b15c5c2738510537812bfa649878a461","Type":"ContainerStarted","Data":"7b22fdc0a7948a8f1c3eb0fc9017f6443aff2c7838328722e46bcf4cff0f370c"}
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.070652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal" event={"ID":"a343a858d6edb11abb86474c850c3d4f","Type":"ContainerStarted","Data":"15a95a7b6b87f59db5f591c596fce76a91d103083ce3427961091254a33d4957"}
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-kubelet\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-run-netns\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-kubelet\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-cnibin\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-netns\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-conf-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-run-netns\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-sys\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aace16b5-8518-46a8-a6fc-96756245cb15-serviceca\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-netns\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbrrd\" (UniqueName: \"kubernetes.io/projected/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-kube-api-access-jbrrd\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-conf-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.096092 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089927    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-sys\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-system-cni-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-cnibin\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.089982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysconfig\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-system-cni-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysconfig\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aace16b5-8518-46a8-a6fc-96756245cb15-host\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aace16b5-8518-46a8-a6fc-96756245cb15-host\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-hosts-file\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-var-lib-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-device-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-kubelet\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-cni-binary-copy\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-node-log\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-var-lib-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-cni-netd\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.098370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-cni-netd\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-hosts-file\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e399d95-1611-4952-aa0b-87587d7759d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-device-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c48792bf-a6ea-4f49-b549-8df6c12261bb-host-slash\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-modprobe-d\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-kubelet\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aace16b5-8518-46a8-a6fc-96756245cb15-serviceca\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-kubernetes\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-node-log\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-ovnkube-script-lib\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-cni-bin\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysctl-conf\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-var-lib-kubelet\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b5eac27-a01d-4a36-8e88-76931231023d-etc-tuned\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-modprobe-d\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-etc-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.099317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-kubernetes\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-cni-binary-copy\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.090978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-etc-openvswitch\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-socket-dir-parent\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c48792bf-a6ea-4f49-b549-8df6c12261bb-host-slash\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-cni-multus\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysctl-conf\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-systemd\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-cni-bin\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8aba721-3554-4bc3-b242-0f8dde0ef77a-agent-certs\") pod \"konnectivity-agent-c7glx\" (UID: \"c8aba721-3554-4bc3-b242-0f8dde0ef77a\") " pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-var-lib-kubelet\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8aba721-3554-4bc3-b242-0f8dde0ef77a-konnectivity-ca\") pod \"konnectivity-agent-c7glx\" (UID: \"c8aba721-3554-4bc3-b242-0f8dde0ef77a\") " pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-var-lib-cni-multus\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-socket-dir-parent\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh2sq\" (UniqueName: \"kubernetes.io/projected/0e399d95-1611-4952-aa0b-87587d7759d0-kube-api-access-zh2sq\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-systemd\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-socket-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.100481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxn9h\" (UniqueName: \"kubernetes.io/projected/aace16b5-8518-46a8-a6fc-96756245cb15-kube-api-access-vxn9h\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-lib-modules\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-slash\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxqgk\" (UniqueName: \"kubernetes.io/projected/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-kube-api-access-kxqgk\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c48792bf-a6ea-4f49-b549-8df6c12261bb-iptables-alerter-script\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-ovn\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h49tp\" (UniqueName: \"kubernetes.io/projected/f4a282d5-6e03-4d74-a825-61a8608032ef-kube-api-access-h49tp\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-lib-modules\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-socket-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-slash\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-run\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-tmp-dir\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-k8s-cni-cncf-io\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwzt2\" (UniqueName: \"kubernetes.io/projected/6b5eac27-a01d-4a36-8e88-76931231023d-kube-api-access-fwzt2\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-sys-fs\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-ovn\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-ovnkube-script-lib\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.101423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-sys-fs\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-os-release\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.091998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-log-socket\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c48792bf-a6ea-4f49-b549-8df6c12261bb-iptables-alerter-script\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-os-release\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-registration-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-hostroot\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-k8s-cni-cncf-io\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-registration-dir\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-multus-certs\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-etc-kubernetes\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-tmp-dir\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-systemd-units\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-host-run-multus-certs\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-etc-kubernetes\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-ovnkube-config\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-hostroot\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-run\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.104160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-log-socket\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-systemd\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-run-systemd\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-systemd-units\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-cni-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ckd\" (UniqueName: \"kubernetes.io/projected/c48792bf-a6ea-4f49-b549-8df6c12261bb-kube-api-access-l4ckd\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-cni-bin\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-cni-dir\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e399d95-1611-4952-aa0b-87587d7759d0-host-cni-bin\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysctl-d\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-host\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b5eac27-a01d-4a36-8e88-76931231023d-tmp\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-env-overrides\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4a282d5-6e03-4d74-a825-61a8608032ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-ovnkube-config\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.105515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-daemon-config\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-host\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.092840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b5eac27-a01d-4a36-8e88-76931231023d-etc-sysctl-d\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.093230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e399d95-1611-4952-aa0b-87587d7759d0-env-overrides\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.093239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-multus-daemon-config\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.093353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8aba721-3554-4bc3-b242-0f8dde0ef77a-konnectivity-ca\") pod \"konnectivity-agent-c7glx\" (UID: \"c8aba721-3554-4bc3-b242-0f8dde0ef77a\") " pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.094318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8aba721-3554-4bc3-b242-0f8dde0ef77a-agent-certs\") pod \"konnectivity-agent-c7glx\" (UID: \"c8aba721-3554-4bc3-b242-0f8dde0ef77a\") " pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.094884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e399d95-1611-4952-aa0b-87587d7759d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.095484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b5eac27-a01d-4a36-8e88-76931231023d-etc-tuned\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.096452    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b5eac27-a01d-4a36-8e88-76931231023d-tmp\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.101151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h49tp\" (UniqueName: \"kubernetes.io/projected/f4a282d5-6e03-4d74-a825-61a8608032ef-kube-api-access-h49tp\") pod \"aws-ebs-csi-driver-node-96vct\" (UID: \"f4a282d5-6e03-4d74-a825-61a8608032ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.103441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxqgk\" (UniqueName: \"kubernetes.io/projected/5600ce2f-605b-4789-92f7-d3fe51f7ffcd-kube-api-access-kxqgk\") pod \"multus-xh8rr\" (UID: \"5600ce2f-605b-4789-92f7-d3fe51f7ffcd\") " pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.104398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh2sq\" (UniqueName: \"kubernetes.io/projected/0e399d95-1611-4952-aa0b-87587d7759d0-kube-api-access-zh2sq\") pod \"ovnkube-node-qhfzq\" (UID: \"0e399d95-1611-4952-aa0b-87587d7759d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.105241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbrrd\" (UniqueName: \"kubernetes.io/projected/d4177f2f-ac39-4e38-8a38-6d4c0903b07b-kube-api-access-jbrrd\") pod \"node-resolver-wd5tt\" (UID: \"d4177f2f-ac39-4e38-8a38-6d4c0903b07b\") " pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.106148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ckd\" (UniqueName: \"kubernetes.io/projected/c48792bf-a6ea-4f49-b549-8df6c12261bb-kube-api-access-l4ckd\") pod \"iptables-alerter-l77pg\" (UID: \"c48792bf-a6ea-4f49-b549-8df6c12261bb\") " pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.106509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxn9h\" (UniqueName: \"kubernetes.io/projected/aace16b5-8518-46a8-a6fc-96756245cb15-kube-api-access-vxn9h\") pod \"node-ca-2zwrd\" (UID: \"aace16b5-8518-46a8-a6fc-96756245cb15\") " pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:04.107337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.106658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwzt2\" (UniqueName: \"kubernetes.io/projected/6b5eac27-a01d-4a36-8e88-76931231023d-kube-api-access-fwzt2\") pod \"tuned-wrfsb\" (UID: \"6b5eac27-a01d-4a36-8e88-76931231023d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.201712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.171053    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:04.201712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.186181    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gql64"
Jul 11 01:06:04.201712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.193932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l77pg"
Jul 11 01:06:04.203138 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.202384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:04.208748 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.206195    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wrfsb"
Jul 11 01:06:04.208748 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.207682    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48792bf_a6ea_4f49_b549_8df6c12261bb.slice/crio-7070e14463dc188033d1b9780c9db9513a6cea87abb6ccd3398ef561ef9d90b2 WatchSource:0}: Error finding container 7070e14463dc188033d1b9780c9db9513a6cea87abb6ccd3398ef561ef9d90b2: Status 404 returned error can't find the container with id 7070e14463dc188033d1b9780c9db9513a6cea87abb6ccd3398ef561ef9d90b2
Jul 11 01:06:04.215584 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.214623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:04.218849 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.216816    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5eac27_a01d_4a36_8e88_76931231023d.slice/crio-e465851537e300ddd3155ea4b3646fcd98e8be6ee751e16480f4fb5e762cfb73 WatchSource:0}: Error finding container e465851537e300ddd3155ea4b3646fcd98e8be6ee751e16480f4fb5e762cfb73: Status 404 returned error can't find the container with id e465851537e300ddd3155ea4b3646fcd98e8be6ee751e16480f4fb5e762cfb73
Jul 11 01:06:04.222678 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.218943    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e399d95_1611_4952_aa0b_87587d7759d0.slice/crio-ae8b94ec6bbd2253647c93087f21dbb4df6ef6eeeaa30196efd7abfcd573d7a9 WatchSource:0}: Error finding container ae8b94ec6bbd2253647c93087f21dbb4df6ef6eeeaa30196efd7abfcd573d7a9: Status 404 returned error can't find the container with id ae8b94ec6bbd2253647c93087f21dbb4df6ef6eeeaa30196efd7abfcd573d7a9
Jul 11 01:06:04.228037 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.223706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct"
Jul 11 01:06:04.228037 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.226775    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8aba721_3554_4bc3_b242_0f8dde0ef77a.slice/crio-976c9b16af137e57078ba0239d306a9e75ddc59fe69d2ed4d480e2e119a24e11 WatchSource:0}: Error finding container 976c9b16af137e57078ba0239d306a9e75ddc59fe69d2ed4d480e2e119a24e11: Status 404 returned error can't find the container with id 976c9b16af137e57078ba0239d306a9e75ddc59fe69d2ed4d480e2e119a24e11
Jul 11 01:06:04.231426 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.231102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wd5tt"
Jul 11 01:06:04.291529 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.237840    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a282d5_6e03_4d74_a825_61a8608032ef.slice/crio-c10ec29778c1827126096b0a9914255b466171cdd19c3c852fa6fd81c8a05883 WatchSource:0}: Error finding container c10ec29778c1827126096b0a9914255b466171cdd19c3c852fa6fd81c8a05883: Status 404 returned error can't find the container with id c10ec29778c1827126096b0a9914255b466171cdd19c3c852fa6fd81c8a05883
Jul 11 01:06:04.291529 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.243245    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4177f2f_ac39_4e38_8a38_6d4c0903b07b.slice/crio-e43fe34475abeedea5135907a0729bf3e17c5731c5d75f9bd92ca050c0f19c90 WatchSource:0}: Error finding container e43fe34475abeedea5135907a0729bf3e17c5731c5d75f9bd92ca050c0f19c90: Status 404 returned error can't find the container with id e43fe34475abeedea5135907a0729bf3e17c5731c5d75f9bd92ca050c0f19c90
Jul 11 01:06:04.291529 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.274229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2zwrd"
Jul 11 01:06:04.291529 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.285100    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaace16b5_8518_46a8_a6fc_96756245cb15.slice/crio-b8ab61cad79aac262058f16abb5b044f51af18eb7784299ae6506b6a11b776c1 WatchSource:0}: Error finding container b8ab61cad79aac262058f16abb5b044f51af18eb7784299ae6506b6a11b776c1: Status 404 returned error can't find the container with id b8ab61cad79aac262058f16abb5b044f51af18eb7784299ae6506b6a11b776c1
Jul 11 01:06:04.291529 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.288098    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xh8rr"
Jul 11 01:06:04.298122 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:04.296628    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5600ce2f_605b_4789_92f7_d3fe51f7ffcd.slice/crio-8b93cc069459daa005b57982de9150eadc88ef2ac386020aa069c2dd881a2128 WatchSource:0}: Error finding container 8b93cc069459daa005b57982de9150eadc88ef2ac386020aa069c2dd881a2128: Status 404 returned error can't find the container with id 8b93cc069459daa005b57982de9150eadc88ef2ac386020aa069c2dd881a2128
Jul 11 01:06:04.496988 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.496779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:04.496988 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.496858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:04.496988 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.496900    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:04.496988 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.496980    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret podName:3b28a717-7879-4ddb-8af2-c781fd0dab18 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:05.496958596 +0000 UTC m=+4.050194495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret") pod "global-pull-secret-syncer-xrbwz" (UID: "3b28a717-7879-4ddb-8af2-c781fd0dab18") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:04.497460 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.497035    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:04.497460 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.497055    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:04.497460 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.497068    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5xfll for pod openshift-network-diagnostics/network-check-target-h42zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:04.497460 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.497114    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:04.497460 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.497127    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll podName:022292b2-96b6-40f2-9663-f6f9304a7f0c nodeName:}" failed. No retries permitted until 2026-07-11 01:06:05.497107944 +0000 UTC m=+4.050343833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xfll" (UniqueName: "kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll") pod "network-check-target-h42zv" (UID: "022292b2-96b6-40f2-9663-f6f9304a7f0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:04.497460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.496908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:04.497460 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:04.497174    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:05.497156451 +0000 UTC m=+4.050392364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:04.906097 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.905957    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 01:01:04 +0000 UTC" deadline="2028-01-31 20:28:08.766044656 +0000 UTC"
Jul 11 01:06:04.906097 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:04.906027    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13675h22m3.860022655s"
Jul 11 01:06:05.050588 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.050030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:05.050588 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.050167    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:05.050588 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.050238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:05.050588 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.050359    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:05.075618 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.075579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"ae8b94ec6bbd2253647c93087f21dbb4df6ef6eeeaa30196efd7abfcd573d7a9"}
Jul 11 01:06:05.078223 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.078139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerStarted","Data":"f1e3eca3eaf1c6e26c6c006acae066a07b21cd9223a556e3da714873b444967c"}
Jul 11 01:06:05.080696 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.080637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xh8rr" event={"ID":"5600ce2f-605b-4789-92f7-d3fe51f7ffcd","Type":"ContainerStarted","Data":"8b93cc069459daa005b57982de9150eadc88ef2ac386020aa069c2dd881a2128"}
Jul 11 01:06:05.082430 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.082321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct" event={"ID":"f4a282d5-6e03-4d74-a825-61a8608032ef","Type":"ContainerStarted","Data":"c10ec29778c1827126096b0a9914255b466171cdd19c3c852fa6fd81c8a05883"}
Jul 11 01:06:05.083777 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.083751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wrfsb" event={"ID":"6b5eac27-a01d-4a36-8e88-76931231023d","Type":"ContainerStarted","Data":"e465851537e300ddd3155ea4b3646fcd98e8be6ee751e16480f4fb5e762cfb73"}
Jul 11 01:06:05.086779 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.086682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l77pg" event={"ID":"c48792bf-a6ea-4f49-b549-8df6c12261bb","Type":"ContainerStarted","Data":"7070e14463dc188033d1b9780c9db9513a6cea87abb6ccd3398ef561ef9d90b2"}
Jul 11 01:06:05.088550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.088483    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2zwrd" event={"ID":"aace16b5-8518-46a8-a6fc-96756245cb15","Type":"ContainerStarted","Data":"b8ab61cad79aac262058f16abb5b044f51af18eb7784299ae6506b6a11b776c1"}
Jul 11 01:06:05.090537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.090505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wd5tt" event={"ID":"d4177f2f-ac39-4e38-8a38-6d4c0903b07b","Type":"ContainerStarted","Data":"e43fe34475abeedea5135907a0729bf3e17c5731c5d75f9bd92ca050c0f19c90"}
Jul 11 01:06:05.091832 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.091777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c7glx" event={"ID":"c8aba721-3554-4bc3-b242-0f8dde0ef77a","Type":"ContainerStarted","Data":"976c9b16af137e57078ba0239d306a9e75ddc59fe69d2ed4d480e2e119a24e11"}
Jul 11 01:06:05.505077 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.505027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:05.505769 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.505108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:05.505769 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.505161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:05.505769 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.505332    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:05.505769 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.505352    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:05.505769 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.505366    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5xfll for pod openshift-network-diagnostics/network-check-target-h42zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:05.505769 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.505426    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll podName:022292b2-96b6-40f2-9663-f6f9304a7f0c nodeName:}" failed. No retries permitted until 2026-07-11 01:06:07.505407268 +0000 UTC m=+6.058643161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xfll" (UniqueName: "kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll") pod "network-check-target-h42zv" (UID: "022292b2-96b6-40f2-9663-f6f9304a7f0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:05.506165 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.505876    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:05.506165 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.505933    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret podName:3b28a717-7879-4ddb-8af2-c781fd0dab18 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:07.505915323 +0000 UTC m=+6.059151214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret") pod "global-pull-secret-syncer-xrbwz" (UID: "3b28a717-7879-4ddb-8af2-c781fd0dab18") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:05.506165 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.505994    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:05.506165 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:05.506031    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:07.506018649 +0000 UTC m=+6.059254538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:05.907259 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.907099    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 01:01:04 +0000 UTC" deadline="2027-12-29 20:28:04.821990238 +0000 UTC"
Jul 11 01:06:05.907259 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:05.907171    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12883h21m58.914823457s"
Jul 11 01:06:06.052819 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:06.051972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:06.052819 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:06.052145    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:07.049973 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:07.049935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:07.050650 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.050087    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:07.050650 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:07.050484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:07.050650 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.050593    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:07.522825 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:07.522781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:07.523048 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:07.522865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:07.523048 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:07.522912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:07.523183 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523079    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:07.523183 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523101    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:07.523183 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523115    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5xfll for pod openshift-network-diagnostics/network-check-target-h42zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:07.523183 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523179    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll podName:022292b2-96b6-40f2-9663-f6f9304a7f0c nodeName:}" failed. No retries permitted until 2026-07-11 01:06:11.523159941 +0000 UTC m=+10.076395833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xfll" (UniqueName: "kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll") pod "network-check-target-h42zv" (UID: "022292b2-96b6-40f2-9663-f6f9304a7f0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:07.523398 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523252    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:07.523398 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523289    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret podName:3b28a717-7879-4ddb-8af2-c781fd0dab18 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:11.523275005 +0000 UTC m=+10.076510895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret") pod "global-pull-secret-syncer-xrbwz" (UID: "3b28a717-7879-4ddb-8af2-c781fd0dab18") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:07.523398 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523371    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:07.523564 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:07.523404    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:11.5233912 +0000 UTC m=+10.076627092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:08.052001 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:08.051967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:08.052499 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:08.052138    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:09.049923 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:09.049885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:09.050124 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:09.050033    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:09.050463 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:09.050442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:09.050577 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:09.050556    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:10.053065 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:10.053034    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:10.053522 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:10.053168    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:11.049867 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:11.049797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:11.049867 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:11.049802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:11.050068 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.049936    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:11.050398 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.050355    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:11.557515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:11.557472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:11.557545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:11.557587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557755    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557780    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557793    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5xfll for pod openshift-network-diagnostics/network-check-target-h42zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557793    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557839    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557892    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll podName:022292b2-96b6-40f2-9663-f6f9304a7f0c nodeName:}" failed. No retries permitted until 2026-07-11 01:06:19.557839086 +0000 UTC m=+18.111074988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xfll" (UniqueName: "kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll") pod "network-check-target-h42zv" (UID: "022292b2-96b6-40f2-9663-f6f9304a7f0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557918    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret podName:3b28a717-7879-4ddb-8af2-c781fd0dab18 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:19.557906282 +0000 UTC m=+18.111142172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret") pod "global-pull-secret-syncer-xrbwz" (UID: "3b28a717-7879-4ddb-8af2-c781fd0dab18") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:11.558071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:11.557960    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:19.557925738 +0000 UTC m=+18.111161629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:12.050826 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:12.050738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:12.050985 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:12.050882    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:13.049171 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:13.049142    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:13.049584 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:13.049281    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:13.049584 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:13.049363    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:13.049584 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:13.049530    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:14.050069 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:14.050027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:14.050454 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:14.050181    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:15.049482 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:15.049450    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:15.049674 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:15.049570    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:15.049674 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:15.049627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:15.049796 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:15.049760    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:16.049237 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:16.049202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:16.049642 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:16.049333    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:17.050254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:17.050215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:17.050254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:17.050263    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:17.050760 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:17.050363    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:17.050760 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:17.050480    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:18.049789 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:18.049753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:18.049975 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:18.049892    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:19.049421 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:19.049388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:19.049831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:19.049389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:19.049831 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.049491    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:19.049831 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.049553    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:19.625426 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:19.625391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:19.625619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:19.625455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:19.625619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:19.625496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:19.625619 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625518    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:19.625619 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625587    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret podName:3b28a717-7879-4ddb-8af2-c781fd0dab18 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:35.625567879 +0000 UTC m=+34.178803780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret") pod "global-pull-secret-syncer-xrbwz" (UID: "3b28a717-7879-4ddb-8af2-c781fd0dab18") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:19.625619 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625593    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:19.625619 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625609    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:19.625938 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625626    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:19.625938 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625638    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5xfll for pod openshift-network-diagnostics/network-check-target-h42zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:19.625938 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625645    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:35.625630142 +0000 UTC m=+34.178866047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:19.625938 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:19.625671    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll podName:022292b2-96b6-40f2-9663-f6f9304a7f0c nodeName:}" failed. No retries permitted until 2026-07-11 01:06:35.625661493 +0000 UTC m=+34.178897390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xfll" (UniqueName: "kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll") pod "network-check-target-h42zv" (UID: "022292b2-96b6-40f2-9663-f6f9304a7f0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:20.049805 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:20.049726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:20.050181 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:20.049862    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:21.050133 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:21.049939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:21.050547 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:21.049966    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:21.050547 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:21.050335    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:21.050547 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:21.050208    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:22.049902 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:22.049865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:22.050071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:22.049983    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:23.049788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:23.049744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:23.050274 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:23.049744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:23.050274 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:23.049930    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:23.050274 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:23.050031    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:24.051613 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.051163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:24.051613 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:24.051568    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:24.132984 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.132955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerStarted","Data":"5a67b831dee150b98f455b27df22e454fa61a209033f5f9101502116ef6d4a5d"}
Jul 11 01:06:24.134557 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.134530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal" event={"ID":"b15c5c2738510537812bfa649878a461","Type":"ContainerStarted","Data":"c9db0cf8174d057c23a9b1493d441a5a8fec89a0c4e0432dce8e526b66b4340f"}
Jul 11 01:06:24.136052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.136006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xh8rr" event={"ID":"5600ce2f-605b-4789-92f7-d3fe51f7ffcd","Type":"ContainerStarted","Data":"c506654b3dbdd93650f4dcd4a49f612e3f8abe4aff044329736b4a0eac87cd48"}
Jul 11 01:06:24.142563 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.142538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct" event={"ID":"f4a282d5-6e03-4d74-a825-61a8608032ef","Type":"ContainerStarted","Data":"6ad622aaf27e0479d9f9ad988509e0dd17700470e2fd9f8b3b5f4fc003aa10bf"}
Jul 11 01:06:24.144027 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.143998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wrfsb" event={"ID":"6b5eac27-a01d-4a36-8e88-76931231023d","Type":"ContainerStarted","Data":"72d8d6e6fb05c5cfb49c5c2006243a685d9a90c6217d677af9d8ab6b81849e18"}
Jul 11 01:06:24.145476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.145456    2563 generic.go:356] "Generic (PLEG): container finished" podID="a343a858d6edb11abb86474c850c3d4f" containerID="afe15856564a9b40d2b8a8222dd56ff05cd0c6ae203351a619513b9d6c20bde5" exitCode=0
Jul 11 01:06:24.145579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.145533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal" event={"ID":"a343a858d6edb11abb86474c850c3d4f","Type":"ContainerDied","Data":"afe15856564a9b40d2b8a8222dd56ff05cd0c6ae203351a619513b9d6c20bde5"}
Jul 11 01:06:24.147095 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.147073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2zwrd" event={"ID":"aace16b5-8518-46a8-a6fc-96756245cb15","Type":"ContainerStarted","Data":"6cb65e7f0d9945aa39094d6a073bb1fe8eaae6fbccfca34db3b3838a0a730c24"}
Jul 11 01:06:24.148533 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.148505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wd5tt" event={"ID":"d4177f2f-ac39-4e38-8a38-6d4c0903b07b","Type":"ContainerStarted","Data":"8c0e186d9ab37ff39a4c2c05ac0fb6987395bc0ded08e79b275817316cb1a629"}
Jul 11 01:06:24.149662 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.149643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c7glx" event={"ID":"c8aba721-3554-4bc3-b242-0f8dde0ef77a","Type":"ContainerStarted","Data":"4a661181ced4b8bebd59fda7cbecd03bfa79a6eef29c6fe85bba5e13f42e64ea"}
Jul 11 01:06:24.152251 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.152233    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:06:24.152556 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.152537    2563 generic.go:356] "Generic (PLEG): container finished" podID="0e399d95-1611-4952-aa0b-87587d7759d0" containerID="81bc439c495a4488d96a3d1ec8433e9ab0a9f4d3de56d2ca0c21dc663a33d4ab" exitCode=1
Jul 11 01:06:24.152614 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.152569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"9038d65a65d7238fe24afc4be230db0d023edd4361f717a9bdd60320403d58e7"}
Jul 11 01:06:24.152649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.152634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerDied","Data":"81bc439c495a4488d96a3d1ec8433e9ab0a9f4d3de56d2ca0c21dc663a33d4ab"}
Jul 11 01:06:24.152722 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.152709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"8f9af3348d092853067605aa47867e4b0b2916beda2c06707b2743cbc6c4023a"}
Jul 11 01:06:24.186551 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.186307    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wrfsb" podStartSLOduration=2.708569487 podStartE2EDuration="22.186291791s" totalImagesPullingTime="19.477722304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:24.172769348 +0000 UTC m=+22.726005255" watchObservedRunningTime="2026-07-11 01:06:24.186291791 +0000 UTC m=+22.739527697"
Jul 11 01:06:24.207719 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.207647    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wd5tt" podStartSLOduration=2.752986925 podStartE2EDuration="22.207625067s" totalImagesPullingTime="19.454638142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:24.207549062 +0000 UTC m=+22.760784970" watchObservedRunningTime="2026-07-11 01:06:24.207625067 +0000 UTC m=+22.760860974"
Jul 11 01:06:24.207946 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.207926    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c7glx" podStartSLOduration=3.129248662 podStartE2EDuration="22.207920308s" totalImagesPullingTime="19.078671646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:24.186084903 +0000 UTC m=+22.739320822" watchObservedRunningTime="2026-07-11 01:06:24.207920308 +0000 UTC m=+22.761156215"
Jul 11 01:06:24.221725 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.221669    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2zwrd" podStartSLOduration=7.57232473 podStartE2EDuration="22.221656077s" totalImagesPullingTime="14.649331347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:24.221386074 +0000 UTC m=+22.774621981" watchObservedRunningTime="2026-07-11 01:06:24.221656077 +0000 UTC m=+22.774891983"
Jul 11 01:06:24.237133 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.237091    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xh8rr" podStartSLOduration=2.788850967 podStartE2EDuration="22.237078176s" totalImagesPullingTime="19.448227209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:24.237018522 +0000 UTC m=+22.790254432" watchObservedRunningTime="2026-07-11 01:06:24.237078176 +0000 UTC m=+22.790314083"
Jul 11 01:06:24.265337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.265283    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-25.ec2.internal" podStartSLOduration=21.265268097 podStartE2EDuration="21.265268097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:24.264812018 +0000 UTC m=+22.818047925" watchObservedRunningTime="2026-07-11 01:06:24.265268097 +0000 UTC m=+22.818504003"
Jul 11 01:06:24.381086 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.381056    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:24.381569 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:24.381550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:25.049921 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.049889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:25.050133 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.049889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:25.050133 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:25.050015    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:25.050133 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:25.050052    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:25.157520 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.157498    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:06:25.158263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.157799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"0a6311e4bd62a434f2ea7e3c36086fd56e8bfc102283db786d2c238ff867b6d9"}
Jul 11 01:06:25.158263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.157863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"20a1ab138d1d96c589bb1c3a0279e07ed747d933d1e6e4f5ae9798de3cb86616"}
Jul 11 01:06:25.158263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.157898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"57ec0cff14e6783eb7a8c3b45274ad91da34664a1eb6804a81a9e9d94f4ed370"}
Jul 11 01:06:25.159152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.159128    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7bda9e9-6737-4a81-8098-6a53c753a915" containerID="5a67b831dee150b98f455b27df22e454fa61a209033f5f9101502116ef6d4a5d" exitCode=0
Jul 11 01:06:25.159272 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.159197    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerDied","Data":"5a67b831dee150b98f455b27df22e454fa61a209033f5f9101502116ef6d4a5d"}
Jul 11 01:06:25.160613 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.160592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l77pg" event={"ID":"c48792bf-a6ea-4f49-b549-8df6c12261bb","Type":"ContainerStarted","Data":"dba840dcd0f9297fc8977b2e4d19284401e2f0dae1b237724ee00f2e87e6be32"}
Jul 11 01:06:25.162188 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.162152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal" event={"ID":"a343a858d6edb11abb86474c850c3d4f","Type":"ContainerStarted","Data":"6d2b8ec348e4fe29693b85b869ebcbe077d21d5460fcbbe78a1e970ae5143805"}
Jul 11 01:06:25.162461 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.162439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:25.162934 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.162914    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c7glx"
Jul 11 01:06:25.196649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.196601    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l77pg" podStartSLOduration=12.19123153 podStartE2EDuration="23.196588873s" totalImagesPullingTime="11.005357343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:25.196480111 +0000 UTC m=+23.749716019" watchObservedRunningTime="2026-07-11 01:06:25.196588873 +0000 UTC m=+23.749824779"
Jul 11 01:06:25.222559 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.222523    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-25.ec2.internal" podStartSLOduration=22.22250983 podStartE2EDuration="22.22250983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:25.222462697 +0000 UTC m=+23.775698603" watchObservedRunningTime="2026-07-11 01:06:25.22250983 +0000 UTC m=+23.775745737"
Jul 11 01:06:25.407334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.407306    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 01:06:25.968631 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.968507    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T01:06:25.407328351Z","UUID":"13a08c89-1d21-47e1-8f8b-d7d4dbdf09f4","Handler":null,"Name":"","Endpoint":""}
Jul 11 01:06:25.970286 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.970264    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 01:06:25.970424 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:25.970308    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 01:06:26.049940 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:26.049906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:26.050166 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:26.050143    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:26.166547 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:26.166478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct" event={"ID":"f4a282d5-6e03-4d74-a825-61a8608032ef","Type":"ContainerStarted","Data":"570c9ce6af982ca34aec5d2e409fc29d9fd87fe7e493db5f96933935dceec9fc"}
Jul 11 01:06:27.049728 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:27.049635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:27.049728 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:27.049668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:27.050085 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:27.049788    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:27.050085 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:27.049904    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:27.171562 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:27.171522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct" event={"ID":"f4a282d5-6e03-4d74-a825-61a8608032ef","Type":"ContainerStarted","Data":"09f18d9424d11783b1b1a24d871dce3e0d9865fecb14962a9b7e856e8979a76b"}
Jul 11 01:06:27.175289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:27.175269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:06:27.175740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:27.175716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"22d70ccc469d2a074d9b0df97d1bcf33fcb7da5a95e9ee07f4a4598cab2cca75"}
Jul 11 01:06:27.186990 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:27.186945    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96vct" podStartSLOduration=3.266425163 podStartE2EDuration="25.186927954s" totalImagesPullingTime="21.920502791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:27.186558296 +0000 UTC m=+25.739794214" watchObservedRunningTime="2026-07-11 01:06:27.186927954 +0000 UTC m=+25.740163861"
Jul 11 01:06:28.049263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:28.049228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:28.049443 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:28.049374    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:29.050026 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:29.049722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:29.050429 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:29.049722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:29.050429 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:29.050090    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:29.050429 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:29.050196    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:30.049904 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.049866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:30.050084 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:30.050012    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:30.185156 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.185133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:06:30.185465 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.185443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"8506f5da0371f8d42f2862da1489f2e6f663bb28d1d0a6ef1856aa48e7e893e7"}
Jul 11 01:06:30.185715 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.185676    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:30.185942 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.185921    2563 scope.go:117] "RemoveContainer" containerID="81bc439c495a4488d96a3d1ec8433e9ab0a9f4d3de56d2ca0c21dc663a33d4ab"
Jul 11 01:06:30.187379 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.187358    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7bda9e9-6737-4a81-8098-6a53c753a915" containerID="dff0cc7f7bfd7b6e6ea1c05810029d1f674fb905e28dbf650d82f4b4fee66715" exitCode=0
Jul 11 01:06:30.187487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.187400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerDied","Data":"dff0cc7f7bfd7b6e6ea1c05810029d1f674fb905e28dbf650d82f4b4fee66715"}
Jul 11 01:06:30.201649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:30.201623    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:31.050521 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.050247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:31.050987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.050258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:31.050987 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:31.050622    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:31.050987 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:31.050714    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:31.193726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.193698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:06:31.194081 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.194059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" event={"ID":"0e399d95-1611-4952-aa0b-87587d7759d0","Type":"ContainerStarted","Data":"69ad12b9f7376fe44cea5c9ad4c6b45d66569ac7bf1ae03c9b622f5e9d43c4a6"}
Jul 11 01:06:31.194242 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.194228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:31.194294 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.194281    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:31.209930 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.209906    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:06:31.222698 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.222639    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq" podStartSLOduration=9.681526878 podStartE2EDuration="29.222623692s" totalImagesPullingTime="19.541096814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:31.221164436 +0000 UTC m=+29.774400353" watchObservedRunningTime="2026-07-11 01:06:31.222623692 +0000 UTC m=+29.775859599"
Jul 11 01:06:31.873998 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.873969    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h42zv"]
Jul 11 01:06:31.874151 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.874091    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:31.874223 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:31.874203    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:31.877638 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.877612    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xrbwz"]
Jul 11 01:06:31.877799 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.877719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:31.877865 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:31.877823    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:31.878386 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.878363    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fd7vb"]
Jul 11 01:06:31.878515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:31.878464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:31.878573 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:31.878549    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:32.198103 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:32.198016    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7bda9e9-6737-4a81-8098-6a53c753a915" containerID="f5047abab515c52435b68ef18723e052400793828c0ab1fe736d979775f91661" exitCode=0
Jul 11 01:06:32.198451 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:32.198109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerDied","Data":"f5047abab515c52435b68ef18723e052400793828c0ab1fe736d979775f91661"}
Jul 11 01:06:33.203033 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:33.202924    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7bda9e9-6737-4a81-8098-6a53c753a915" containerID="adb6fb10af491cf57a33ade70570734b4a8dd67b6d6699785febe7a75f3182b7" exitCode=0
Jul 11 01:06:33.203033 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:33.202962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerDied","Data":"adb6fb10af491cf57a33ade70570734b4a8dd67b6d6699785febe7a75f3182b7"}
Jul 11 01:06:34.049863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:34.049829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:34.050051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:34.049829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:34.050051 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:34.049975    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:34.050051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:34.049843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:34.050221 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:34.050058    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:34.050221 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:34.050145    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:35.638821 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:35.638785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:35.638837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:35.638862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.638937    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.638958    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.638970    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.638976    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.639004    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret podName:3b28a717-7879-4ddb-8af2-c781fd0dab18 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:07.638988309 +0000 UTC m=+66.192224194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret") pod "global-pull-secret-syncer-xrbwz" (UID: "3b28a717-7879-4ddb-8af2-c781fd0dab18") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.639023    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:07.639010592 +0000 UTC m=+66.192246477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.638979    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5xfll for pod openshift-network-diagnostics/network-check-target-h42zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:35.639203 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:35.639052    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll podName:022292b2-96b6-40f2-9663-f6f9304a7f0c nodeName:}" failed. No retries permitted until 2026-07-11 01:07:07.639046286 +0000 UTC m=+66.192282172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xfll" (UniqueName: "kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll") pod "network-check-target-h42zv" (UID: "022292b2-96b6-40f2-9663-f6f9304a7f0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:36.050298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.049921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:36.050298 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.050061    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrbwz" podUID="3b28a717-7879-4ddb-8af2-c781fd0dab18"
Jul 11 01:06:36.050298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.050260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:36.050562 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.050374    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:06:36.050562 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.050416    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:36.050562 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.050479    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42zv" podUID="022292b2-96b6-40f2-9663-f6f9304a7f0c"
Jul 11 01:06:36.684460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.684236    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-25.ec2.internal" event="NodeReady"
Jul 11 01:06:36.684965 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.684605    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 01:06:36.725739 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.725702    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8c4ff965c-kg2cp"]
Jul 11 01:06:36.749879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.749851    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vdcrx"]
Jul 11 01:06:36.750066 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.749957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.750774 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.750629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:36.753010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.752789    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 11 01:06:36.753010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.752856    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 11 01:06:36.753010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.752881    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 11 01:06:36.753870 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.753075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fljvr\""
Jul 11 01:06:36.758583 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.758560    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 11 01:06:36.761116 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.760290    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-25tfx"]
Jul 11 01:06:36.761116 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.760513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.762624 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.762602    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 01:06:36.762793 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.762776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 01:06:36.762882 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.762612    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzrhh\""
Jul 11 01:06:36.776394 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.776364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8c4ff965c-kg2cp"]
Jul 11 01:06:36.776394 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.776394    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-25tfx"]
Jul 11 01:06:36.776575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.776407    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vdcrx"]
Jul 11 01:06:36.776575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.776436    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n5fgk"]
Jul 11 01:06:36.776575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.776543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:36.779043 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.778869    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 11 01:06:36.779043 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.778915    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 11 01:06:36.779043 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.778923    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s9g7s\""
Jul 11 01:06:36.787351 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.787331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5fgk"]
Jul 11 01:06:36.787468 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.787422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:36.789610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.789590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 01:06:36.789791 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.789729    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 01:06:36.789791 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.789759    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mzv2k\""
Jul 11 01:06:36.790052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.790033    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 01:06:36.845317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.845277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:36.849185 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-bound-sa-token\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.849314 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z2nz\" (UniqueName: \"kubernetes.io/projected/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-kube-api-access-2z2nz\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.849314 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.849314 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.849443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-config-volume\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.849443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-tmp-dir\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.849443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-installation-pull-secrets\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.849443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-image-registry-private-configuration\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.849603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-trusted-ca\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.849603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-certificates\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.849603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6110e1bf-737f-4ddf-9e71-c62577be85c3-ca-trust-extracted\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.849745 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.849608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rqvc\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-kube-api-access-8rqvc\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.943448 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.943329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:36.950189 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6110e1bf-737f-4ddf-9e71-c62577be85c3-ca-trust-extracted\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950365 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rqvc\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-kube-api-access-8rqvc\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950365 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-bound-sa-token\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950477 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z2nz\" (UniqueName: \"kubernetes.io/projected/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-kube-api-access-2z2nz\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.950530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.950637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-config-volume\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.950637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-tmp-dir\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.950637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkpmb\" (UniqueName: \"kubernetes.io/projected/054bdd86-4a49-421e-9e4d-33f7ce248bb4-kube-api-access-fkpmb\") pod \"ingress-canary-n5fgk\" (UID: \"054bdd86-4a49-421e-9e4d-33f7ce248bb4\") " pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:36.950637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6110e1bf-737f-4ddf-9e71-c62577be85c3-ca-trust-extracted\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-installation-pull-secrets\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950901 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.950632    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:36.950901 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.950660    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:06:36.950901 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-image-registry-private-configuration\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950901 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-trusted-ca\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.950901 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.950745    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:37.450725323 +0000 UTC m=+36.003961209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:06:36.950901 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.950633    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:36.951152 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:36.950907    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:37.450878464 +0000 UTC m=+36.004114351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:36.951152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c687634c-5588-4dc9-abe3-44ec590658eb-nginx-conf\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:36.951152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.950997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-tmp-dir\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.951152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.951022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/054bdd86-4a49-421e-9e4d-33f7ce248bb4-cert\") pod \"ingress-canary-n5fgk\" (UID: \"054bdd86-4a49-421e-9e4d-33f7ce248bb4\") " pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:36.951152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.951074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-certificates\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.951152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.951102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:36.951567 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.951543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-certificates\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.951796 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.951779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-trusted-ca\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.955798 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.955775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-image-registry-private-configuration\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.955943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.955809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-installation-pull-secrets\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.958570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.958542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z2nz\" (UniqueName: \"kubernetes.io/projected/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-kube-api-access-2z2nz\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:36.959482 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.959461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-bound-sa-token\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.959591 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.959571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rqvc\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-kube-api-access-8rqvc\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:36.967587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:36.967555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-config-volume\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:37.002109 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.002066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:37.052051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.052004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:37.052259 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.052141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkpmb\" (UniqueName: \"kubernetes.io/projected/054bdd86-4a49-421e-9e4d-33f7ce248bb4-kube-api-access-fkpmb\") pod \"ingress-canary-n5fgk\" (UID: \"054bdd86-4a49-421e-9e4d-33f7ce248bb4\") " pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:37.052259 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.052177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c687634c-5588-4dc9-abe3-44ec590658eb-nginx-conf\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:37.052259 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.052177    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:06:37.052259 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.052195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/054bdd86-4a49-421e-9e4d-33f7ce248bb4-cert\") pod \"ingress-canary-n5fgk\" (UID: \"054bdd86-4a49-421e-9e4d-33f7ce248bb4\") " pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:37.052473 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.052275    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:06:37.552251931 +0000 UTC m=+36.105487820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:06:37.052917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.052888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c687634c-5588-4dc9-abe3-44ec590658eb-nginx-conf\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:37.055104 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.055083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/054bdd86-4a49-421e-9e4d-33f7ce248bb4-cert\") pod \"ingress-canary-n5fgk\" (UID: \"054bdd86-4a49-421e-9e4d-33f7ce248bb4\") " pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:37.062711 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.062672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkpmb\" (UniqueName: \"kubernetes.io/projected/054bdd86-4a49-421e-9e4d-33f7ce248bb4-kube-api-access-fkpmb\") pod \"ingress-canary-n5fgk\" (UID: \"054bdd86-4a49-421e-9e4d-33f7ce248bb4\") " pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:37.097314 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.097286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5fgk"
Jul 11 01:06:37.455483 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.455441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:37.455483 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.455486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:37.455867 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.455608    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:37.455867 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.455620    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:37.455867 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.455642    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:06:37.455867 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.455669    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:38.455649436 +0000 UTC m=+37.008885338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:37.455867 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.455733    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:38.45571565 +0000 UTC m=+37.008951542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:06:37.528749 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.528713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:37.556355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.556321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:37.556518 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.556458    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:06:37.556560 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:37.556521    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:06:38.556507575 +0000 UTC m=+37.109743464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:06:37.630702 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.630637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:37.758759 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.758618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5fgk"]
Jul 11 01:06:37.841067 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:06:37.841035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054bdd86_4a49_421e_9e4d_33f7ce248bb4.slice/crio-7e3807f642a2d5b622b4ef077b9952ca7dd20d779678b75f5f238f17d61c3761 WatchSource:0}: Error finding container 7e3807f642a2d5b622b4ef077b9952ca7dd20d779678b75f5f238f17d61c3761: Status 404 returned error can't find the container with id 7e3807f642a2d5b622b4ef077b9952ca7dd20d779678b75f5f238f17d61c3761
Jul 11 01:06:37.978663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:37.978405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:38.036940 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.036908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:38.049643 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.049617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:06:38.049792 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.049619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:06:38.049792 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.049626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:06:38.052569 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.052546    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 01:06:38.052757 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.052547    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 01:06:38.052757 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.052654    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8v8tm\""
Jul 11 01:06:38.052895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.052827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 01:06:38.052895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.052841    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ms55\""
Jul 11 01:06:38.052895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.052875    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 01:06:38.219932 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.219890    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7bda9e9-6737-4a81-8098-6a53c753a915" containerID="7b83b41a207b3bd49fd0f421c57afebc0ac0a9813570e254f0dee806da5f443c" exitCode=0
Jul 11 01:06:38.220113 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.219968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerDied","Data":"7b83b41a207b3bd49fd0f421c57afebc0ac0a9813570e254f0dee806da5f443c"}
Jul 11 01:06:38.221071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.221053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5fgk" event={"ID":"054bdd86-4a49-421e-9e4d-33f7ce248bb4","Type":"ContainerStarted","Data":"7e3807f642a2d5b622b4ef077b9952ca7dd20d779678b75f5f238f17d61c3761"}
Jul 11 01:06:38.464165 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.464129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:38.464312 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.464238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:38.464312 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:38.464245    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:38.464312 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:38.464267    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:06:38.464425 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:38.464323    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:40.464303083 +0000 UTC m=+39.017538969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:06:38.464425 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:38.464375    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:38.464425 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:38.464422    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:40.464410415 +0000 UTC m=+39.017646299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:38.565589 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.565509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:38.565766 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:38.565663    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:06:38.565766 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:38.565740    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:06:40.5657223 +0000 UTC m=+39.118958207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:06:38.667254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.667204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:38.767597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:38.767556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:39.228012 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:39.227973    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7bda9e9-6737-4a81-8098-6a53c753a915" containerID="5f0a62c1bf38fc7d5f2b1d333bb50fb70d4e78ea31860c92303c8a0be3af338e" exitCode=0
Jul 11 01:06:39.228207 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:39.228023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerDied","Data":"5f0a62c1bf38fc7d5f2b1d333bb50fb70d4e78ea31860c92303c8a0be3af338e"}
Jul 11 01:06:40.233611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.233575    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gql64" event={"ID":"f7bda9e9-6737-4a81-8098-6a53c753a915","Type":"ContainerStarted","Data":"065bdc01f21c66fbbda0c4df27a9ee63d63be72e8d589f1bc57870a2ea5d97cf"}
Jul 11 01:06:40.254443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.254385    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gql64" podStartSLOduration=15.91779393 podStartE2EDuration="38.2543636s" totalImagesPullingTime="22.33656967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:40.252915377 +0000 UTC m=+38.806151284" watchObservedRunningTime="2026-07-11 01:06:40.2543636 +0000 UTC m=+38.807599507"
Jul 11 01:06:40.374955 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.374919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:40.472546 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.472507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:40.481294 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.481262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:40.481438 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.481308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:40.481438 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:40.481403    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:40.481438 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:40.481424    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:06:40.481544 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:40.481438    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:40.481544 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:40.481485    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:44.481467647 +0000 UTC m=+43.034703542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:40.481544 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:40.481501    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:44.481492897 +0000 UTC m=+43.034728782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:06:40.582229 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.582139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:40.582389 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:40.582285    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:06:40.582389 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:40.582361    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:06:44.582341187 +0000 UTC m=+43.135577076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:06:40.946227 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.946168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:40.994581 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:40.994547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:41.045333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:41.045287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:41.996070 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:41.995983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:42.049424 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:42.049387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:42.240285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:42.240245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:42.241148 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:42.241113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5fgk" event={"ID":"054bdd86-4a49-421e-9e4d-33f7ce248bb4","Type":"ContainerStarted","Data":"0af289301bf161d07df202643820cb01882fc4463906d75bb781a2d88928453c"}
Jul 11 01:06:42.256763 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:42.256664    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n5fgk" podStartSLOduration=2.493495985 podStartE2EDuration="6.256649049s" totalImagesPullingTime="3.763153064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:42.256304129 +0000 UTC m=+40.809540037" watchObservedRunningTime="2026-07-11 01:06:42.256649049 +0000 UTC m=+40.809884976"
Jul 11 01:06:42.294387 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:42.294354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:42.923890 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:42.923855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:43.015523 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:43.015493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:43.115841 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:43.115801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:44.516273 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:44.516233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:44.516273 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:44.516267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:44.516719 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:44.516385    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:44.516719 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:44.516390    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:44.516719 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:44.516407    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:06:44.516719 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:44.516441    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:52.516426491 +0000 UTC m=+51.069662378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:44.516719 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:44.516455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:52.516448848 +0000 UTC m=+51.069684732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:06:44.617216 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:44.617179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:44.617377 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:44.617300    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:06:44.617377 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:44.617348    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:06:52.617336357 +0000 UTC m=+51.170572241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:06:52.571939 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:52.571896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:06:52.571939 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:52.571939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:06:52.572395 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:52.572032    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:52.572395 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:52.572038    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:52.572395 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:52.572056    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:06:52.572395 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:52.572103    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:08.572076407 +0000 UTC m=+67.125312291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:52.572395 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:52.572121    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:08.572114147 +0000 UTC m=+67.125350032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:06:52.672953 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:52.672908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:06:52.673116 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:52.673060    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:06:52.673195 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:06:52.673133    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:07:08.673112257 +0000 UTC m=+67.226348157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:06:55.045945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:55.045907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:55.094653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:55.094619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:58.351087 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:58.351047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:58.455540 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:58.455504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:58.647496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:58.647462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:58.712935 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:58.712902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:58.811995 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:58.811962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:58.912191 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:58.912099    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:59.113464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:59.113432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:59.164472 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:59.164399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:06:59.723952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:06:59.723915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:00.107032 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:00.106947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:00.155670 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:00.155642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:03.213622 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:03.213590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhfzq"
Jul 11 01:07:03.360339 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:03.360303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:03.457728 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:03.457698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:06.312024 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:06.311986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:07.685868 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.685836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:07:07.686228 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.685881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:07:07.686228 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.685996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:07:07.688342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.688309    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 01:07:07.688496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.688413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 01:07:07.688496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.688470    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 01:07:07.697066 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:07.697050    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 01:07:07.697168 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:07.697103    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:08:11.697087384 +0000 UTC m=+130.250323272 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : secret "metrics-daemon-secret" not found
Jul 11 01:07:07.698746 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.698728    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 01:07:07.700723 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.700703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b28a717-7879-4ddb-8af2-c781fd0dab18-original-pull-secret\") pod \"global-pull-secret-syncer-xrbwz\" (UID: \"3b28a717-7879-4ddb-8af2-c781fd0dab18\") " pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:07:07.709481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.709463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xfll\" (UniqueName: \"kubernetes.io/projected/022292b2-96b6-40f2-9663-f6f9304a7f0c-kube-api-access-5xfll\") pod \"network-check-target-h42zv\" (UID: \"022292b2-96b6-40f2-9663-f6f9304a7f0c\") " pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:07:07.811823 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.811802    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8v8tm\""
Jul 11 01:07:07.820750 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.820732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:07:07.820872 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.820854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrbwz"
Jul 11 01:07:07.972261 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.972233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h42zv"]
Jul 11 01:07:07.975549 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:07:07.975526    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022292b2_96b6_40f2_9663_f6f9304a7f0c.slice/crio-7fca44056584f97025433dfc6caea2d3f2f23edab3503f9e67fcdbe09cd0b7c6 WatchSource:0}: Error finding container 7fca44056584f97025433dfc6caea2d3f2f23edab3503f9e67fcdbe09cd0b7c6: Status 404 returned error can't find the container with id 7fca44056584f97025433dfc6caea2d3f2f23edab3503f9e67fcdbe09cd0b7c6
Jul 11 01:07:07.993044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:07.993022    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xrbwz"]
Jul 11 01:07:07.995866 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:07:07.995841    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b28a717_7879_4ddb_8af2_c781fd0dab18.slice/crio-06817b63c1a65f0deae0ba9ce6620df516afdac5cbff02170aba44647e82b66f WatchSource:0}: Error finding container 06817b63c1a65f0deae0ba9ce6620df516afdac5cbff02170aba44647e82b66f: Status 404 returned error can't find the container with id 06817b63c1a65f0deae0ba9ce6620df516afdac5cbff02170aba44647e82b66f
Jul 11 01:07:08.299610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:08.299528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xrbwz" event={"ID":"3b28a717-7879-4ddb-8af2-c781fd0dab18","Type":"ContainerStarted","Data":"06817b63c1a65f0deae0ba9ce6620df516afdac5cbff02170aba44647e82b66f"}
Jul 11 01:07:08.300644 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:08.300614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h42zv" event={"ID":"022292b2-96b6-40f2-9663-f6f9304a7f0c","Type":"ContainerStarted","Data":"7fca44056584f97025433dfc6caea2d3f2f23edab3503f9e67fcdbe09cd0b7c6"}
Jul 11 01:07:08.593020 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:08.592944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:07:08.593020 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:08.592983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:07:08.593218 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:08.593097    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:07:08.593218 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:08.593126    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:07:08.593218 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:08.593178    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:40.593162655 +0000 UTC m=+99.146398540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:07:08.593218 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:08.593100    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:07:08.593395 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:08.593274    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:40.593257523 +0000 UTC m=+99.146493425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:07:08.693855 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:08.693823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:07:08.694497 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:08.693990    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:07:08.694497 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:08.694059    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:07:40.694041375 +0000 UTC m=+99.247277268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:07:10.559918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:10.559810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:10.660353 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:10.660317    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:11.310590 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:11.310557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h42zv" event={"ID":"022292b2-96b6-40f2-9663-f6f9304a7f0c","Type":"ContainerStarted","Data":"dc9e6cf3cf276214e912b0b0f1bcdf97aae0b34054573360faea0d5b8ac72e88"}
Jul 11 01:07:11.310731 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:11.310696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:07:11.324933 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:11.324891    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h42zv" podStartSLOduration=66.084498611 podStartE2EDuration="1m9.324872344s" totalImagesPullingTime="3.240373733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:11.323663387 +0000 UTC m=+69.876899295" watchObservedRunningTime="2026-07-11 01:07:11.324872344 +0000 UTC m=+69.878108250"
Jul 11 01:07:13.316996 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:13.316955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xrbwz" event={"ID":"3b28a717-7879-4ddb-8af2-c781fd0dab18","Type":"ContainerStarted","Data":"bbd304d370805917cbfc0f59f4204e37c4a92b2ce3ea9b6bac47665036279fe8"}
Jul 11 01:07:13.330735 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:13.330676    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xrbwz" podStartSLOduration=66.686520298 podStartE2EDuration="1m11.330662781s" totalImagesPullingTime="4.644142483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:13.330160388 +0000 UTC m=+71.883396309" watchObservedRunningTime="2026-07-11 01:07:13.330662781 +0000 UTC m=+71.883898666"
Jul 11 01:07:15.813178 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:15.813136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:15.862972 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:15.862943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:16.281496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:16.281456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:16.330832 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:16.330799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:20.060524 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:20.060494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:20.115365 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:20.115333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:36.744824 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:36.744704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:36.845545 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:36.845515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:07:40.622452 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:40.622412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:07:40.622452 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:40.622451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:07:40.622933 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:40.622549    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:07:40.622933 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:40.622574    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:07:40.622933 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:40.622596    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:07:40.622933 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:40.622616    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:08:44.622598373 +0000 UTC m=+163.175834276 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:07:40.622933 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:40.622651    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:08:44.622637517 +0000 UTC m=+163.175873403 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:07:40.723549 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:40.723512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:07:40.723727 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:40.723664    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:07:40.723769 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:07:40.723745    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:08:44.723728648 +0000 UTC m=+163.276964537 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:07:42.316308 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:07:42.316275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h42zv"
Jul 11 01:08:04.499829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:04.499786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:08:04.545703 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:04.545639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:08:11.756960 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:11.756900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:08:11.757570 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:11.757081    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 01:08:11.757570 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:11.757180    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:13.757158391 +0000 UTC m=+252.310394279 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : secret "metrics-daemon-secret" not found
Jul 11 01:08:39.764731 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:39.764670    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3"
Jul 11 01:08:39.771832 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:39.771801    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vdcrx" podUID="3c8a94a0-f9a2-42d3-bab2-af5d8084a562"
Jul 11 01:08:39.786953 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:39.786929    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx" podUID="c687634c-5588-4dc9-abe3-44ec590658eb"
Jul 11 01:08:40.521469 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:40.521442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:08:40.521670 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:40.521442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:08:41.115927 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:41.115884    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:08:44.694842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:44.694805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:08:44.694842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:44.694840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:08:44.695293 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:44.694954    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:08:44.695293 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:44.694963    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:08:44.695293 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:44.694984    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8c4ff965c-kg2cp: secret "image-registry-tls" not found
Jul 11 01:08:44.695293 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:44.695012    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls podName:3c8a94a0-f9a2-42d3-bab2-af5d8084a562 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:46.694999038 +0000 UTC m=+285.248234923 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls") pod "dns-default-vdcrx" (UID: "3c8a94a0-f9a2-42d3-bab2-af5d8084a562") : secret "dns-default-metrics-tls" not found
Jul 11 01:08:44.695293 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:44.695044    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls podName:6110e1bf-737f-4ddf-9e71-c62577be85c3 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:46.695029736 +0000 UTC m=+285.248265621 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls") pod "image-registry-8c4ff965c-kg2cp" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3") : secret "image-registry-tls" not found
Jul 11 01:08:44.795136 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:44.795099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:08:44.795315 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:44.795237    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:08:44.795315 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:08:44.795311    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:46.79529508 +0000 UTC m=+285.348530965 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:08:51.049614 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:51.049582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:08:56.049618 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:08:56.049525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:10:04.803823 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:04.803790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:13.815248 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:13.815203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:10:13.815739 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:13.815417    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 01:10:13.815739 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:13.815539    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs podName:ad78a13b-e32c-49aa-887e-dee668138a07 nodeName:}" failed. No retries permitted until 2026-07-11 01:12:15.815513823 +0000 UTC m=+374.368749708 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs") pod "network-metrics-daemon-fd7vb" (UID: "ad78a13b-e32c-49aa-887e-dee668138a07") : secret "metrics-daemon-secret" not found
Jul 11 01:10:30.480302 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.480223    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"]
Jul 11 01:10:30.481959 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.481942    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"]
Jul 11 01:10:30.482069 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.482052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.484422 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.484391    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 11 01:10:30.484422 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.484401    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-td2bp\""
Jul 11 01:10:30.484602 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.484409    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"]
Jul 11 01:10:30.484602 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.484477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:30.484945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.484927    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.485034 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.484988    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.486224 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.486181    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-q7gph"]
Jul 11 01:10:30.486321 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.486256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.486737 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.486721    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6fzkv\""
Jul 11 01:10:30.486897 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.486884    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.486958 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.486889    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 11 01:10:30.486958 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.486946    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.487127 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.487113    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 11 01:10:30.488106 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.488089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.488400 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.488380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.488483 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.488439    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 11 01:10:30.488483 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.488462    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.488738 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.488722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 11 01:10:30.489086 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.489063    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w24wg\""
Jul 11 01:10:30.490786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.490769    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 11 01:10:30.490860 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.490774    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.491049 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.491037    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.491123 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.491107    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zd24x\""
Jul 11 01:10:30.491495 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.491479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 11 01:10:30.495984 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.495968    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 11 01:10:30.498383 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.498365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"]
Jul 11 01:10:30.499238 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.499209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"]
Jul 11 01:10:30.500153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.500136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-q7gph"]
Jul 11 01:10:30.511835 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.511815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"]
Jul 11 01:10:30.534796 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b2eec6-f217-45c6-a4cc-5807f06c9599-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.534887 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf40fcb-4027-433e-925f-be826b1e77ed-serving-cert\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.534887 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pczkj\" (UniqueName: \"kubernetes.io/projected/d2f4909e-9134-44fc-8e02-f749429e3c32-kube-api-access-pczkj\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:30.534887 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh27n\" (UniqueName: \"kubernetes.io/projected/eaf40fcb-4027-433e-925f-be826b1e77ed-kube-api-access-dh27n\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.534987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a93c01e8-f32f-44f5-a86f-0a8763763fb5-trusted-ca\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.534987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:30.534987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0b2eec6-f217-45c6-a4cc-5807f06c9599-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.535077 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.534991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a93c01e8-f32f-44f5-a86f-0a8763763fb5-serving-cert\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.535077 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.535020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf89k\" (UniqueName: \"kubernetes.io/projected/a93c01e8-f32f-44f5-a86f-0a8763763fb5-kube-api-access-kf89k\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.535077 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.535055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td9dl\" (UniqueName: \"kubernetes.io/projected/d0b2eec6-f217-45c6-a4cc-5807f06c9599-kube-api-access-td9dl\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.535171 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.535077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eaf40fcb-4027-433e-925f-be826b1e77ed-config\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.535171 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.535095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a93c01e8-f32f-44f5-a86f-0a8763763fb5-config\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.636110 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b2eec6-f217-45c6-a4cc-5807f06c9599-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.636328 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf40fcb-4027-433e-925f-be826b1e77ed-serving-cert\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.636569 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pczkj\" (UniqueName: \"kubernetes.io/projected/d2f4909e-9134-44fc-8e02-f749429e3c32-kube-api-access-pczkj\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:30.636634 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh27n\" (UniqueName: \"kubernetes.io/projected/eaf40fcb-4027-433e-925f-be826b1e77ed-kube-api-access-dh27n\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.636713 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a93c01e8-f32f-44f5-a86f-0a8763763fb5-trusted-ca\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.636775 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:30.636775 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0b2eec6-f217-45c6-a4cc-5807f06c9599-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.636923 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a93c01e8-f32f-44f5-a86f-0a8763763fb5-serving-cert\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.636923 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.636832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf89k\" (UniqueName: \"kubernetes.io/projected/a93c01e8-f32f-44f5-a86f-0a8763763fb5-kube-api-access-kf89k\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.637050 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.637031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td9dl\" (UniqueName: \"kubernetes.io/projected/d0b2eec6-f217-45c6-a4cc-5807f06c9599-kube-api-access-td9dl\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.637305 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.637288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eaf40fcb-4027-433e-925f-be826b1e77ed-config\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.637482 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.637468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a93c01e8-f32f-44f5-a86f-0a8763763fb5-config\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.640725 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.637917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0b2eec6-f217-45c6-a4cc-5807f06c9599-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.640725 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:30.638831    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 01:10:30.640725 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.639147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a93c01e8-f32f-44f5-a86f-0a8763763fb5-config\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.640725 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.639674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eaf40fcb-4027-433e-925f-be826b1e77ed-config\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.640725 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:30.639899    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls podName:d2f4909e-9134-44fc-8e02-f749429e3c32 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:31.139875647 +0000 UTC m=+269.693111539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r27n" (UID: "d2f4909e-9134-44fc-8e02-f749429e3c32") : secret "samples-operator-tls" not found
Jul 11 01:10:30.640725 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.640064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf40fcb-4027-433e-925f-be826b1e77ed-serving-cert\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.641859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.641396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b2eec6-f217-45c6-a4cc-5807f06c9599-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.641859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.641734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a93c01e8-f32f-44f5-a86f-0a8763763fb5-serving-cert\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.642166 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.642140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a93c01e8-f32f-44f5-a86f-0a8763763fb5-trusted-ca\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.644273 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.644250    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pczkj\" (UniqueName: \"kubernetes.io/projected/d2f4909e-9134-44fc-8e02-f749429e3c32-kube-api-access-pczkj\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:30.644466 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.644451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh27n\" (UniqueName: \"kubernetes.io/projected/eaf40fcb-4027-433e-925f-be826b1e77ed-kube-api-access-dh27n\") pod \"service-ca-operator-7695fc6c8c-chx6v\" (UID: \"eaf40fcb-4027-433e-925f-be826b1e77ed\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.645312 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.645295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td9dl\" (UniqueName: \"kubernetes.io/projected/d0b2eec6-f217-45c6-a4cc-5807f06c9599-kube-api-access-td9dl\") pod \"kube-storage-version-migrator-operator-799cb7f958-ntsgr\" (UID: \"d0b2eec6-f217-45c6-a4cc-5807f06c9599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.645594 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.645575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf89k\" (UniqueName: \"kubernetes.io/projected/a93c01e8-f32f-44f5-a86f-0a8763763fb5-kube-api-access-kf89k\") pod \"console-operator-7866497494-q7gph\" (UID: \"a93c01e8-f32f-44f5-a86f-0a8763763fb5\") " pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.691194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.691171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:30.739384 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.739323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:30.792768 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.792742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"
Jul 11 01:10:30.806250 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.806232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"
Jul 11 01:10:30.811223 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.811192    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:30.931176 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:30.931133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v"]
Jul 11 01:10:30.934394 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:10:30.934369    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf40fcb_4027_433e_925f_be826b1e77ed.slice/crio-a92b6cd111dab602a3b593f9b399020a9b8f74a0197fc515aaeca4af6825fc4f WatchSource:0}: Error finding container a92b6cd111dab602a3b593f9b399020a9b8f74a0197fc515aaeca4af6825fc4f: Status 404 returned error can't find the container with id a92b6cd111dab602a3b593f9b399020a9b8f74a0197fc515aaeca4af6825fc4f
Jul 11 01:10:31.142568 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:31.142542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:31.142714 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:31.142646    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 01:10:31.142714 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:31.142711    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls podName:d2f4909e-9134-44fc-8e02-f749429e3c32 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:32.142697284 +0000 UTC m=+270.695933188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r27n" (UID: "d2f4909e-9134-44fc-8e02-f749429e3c32") : secret "samples-operator-tls" not found
Jul 11 01:10:31.152153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:31.152050    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-q7gph"]
Jul 11 01:10:31.154823 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:10:31.154802    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93c01e8_f32f_44f5_a86f_0a8763763fb5.slice/crio-468577db81291a0d9de3d377deae9bb9e0024c29f9a5d444227b75d50a2139df WatchSource:0}: Error finding container 468577db81291a0d9de3d377deae9bb9e0024c29f9a5d444227b75d50a2139df: Status 404 returned error can't find the container with id 468577db81291a0d9de3d377deae9bb9e0024c29f9a5d444227b75d50a2139df
Jul 11 01:10:31.155022 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:31.155004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr"]
Jul 11 01:10:31.157517 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:10:31.157499    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b2eec6_f217_45c6_a4cc_5807f06c9599.slice/crio-fb8a5e1a969527c2113c44240b12072134a9367947079696c91b7172aad03030 WatchSource:0}: Error finding container fb8a5e1a969527c2113c44240b12072134a9367947079696c91b7172aad03030: Status 404 returned error can't find the container with id fb8a5e1a969527c2113c44240b12072134a9367947079696c91b7172aad03030
Jul 11 01:10:31.778879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:31.778845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr" event={"ID":"d0b2eec6-f217-45c6-a4cc-5807f06c9599","Type":"ContainerStarted","Data":"fb8a5e1a969527c2113c44240b12072134a9367947079696c91b7172aad03030"}
Jul 11 01:10:31.779863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:31.779840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-q7gph" event={"ID":"a93c01e8-f32f-44f5-a86f-0a8763763fb5","Type":"ContainerStarted","Data":"468577db81291a0d9de3d377deae9bb9e0024c29f9a5d444227b75d50a2139df"}
Jul 11 01:10:31.780739 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:31.780719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v" event={"ID":"eaf40fcb-4027-433e-925f-be826b1e77ed","Type":"ContainerStarted","Data":"a92b6cd111dab602a3b593f9b399020a9b8f74a0197fc515aaeca4af6825fc4f"}
Jul 11 01:10:32.151155 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:32.151118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:32.151379 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:32.151278    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 01:10:32.151379 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:32.151348    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls podName:d2f4909e-9134-44fc-8e02-f749429e3c32 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:34.151328882 +0000 UTC m=+272.704564774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r27n" (UID: "d2f4909e-9134-44fc-8e02-f749429e3c32") : secret "samples-operator-tls" not found
Jul 11 01:10:33.565844 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:33.565814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:33.666330 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:33.666292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:34.167537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.167489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:34.167757 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:34.167647    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 01:10:34.167757 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:34.167747    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls podName:d2f4909e-9134-44fc-8e02-f749429e3c32 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.167724546 +0000 UTC m=+276.720960432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r27n" (UID: "d2f4909e-9134-44fc-8e02-f749429e3c32") : secret "samples-operator-tls" not found
Jul 11 01:10:34.574384 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.574315    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rpnj5"]
Jul 11 01:10:34.576236 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.576221    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.579263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.579241    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 01:10:34.580081 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.580059    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4nn2\""
Jul 11 01:10:34.580173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.580097    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 01:10:34.580173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.580095    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 01:10:34.581103 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.581087    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 01:10:34.592346 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.592323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rpnj5"]
Jul 11 01:10:34.619507 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.619482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:34.670787 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.670758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-data-volume\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.670893 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.670805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-crio-socket\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.670893 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.670828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.671010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.670921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.671010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.670972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64hsc\" (UniqueName: \"kubernetes.io/projected/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-api-access-64hsc\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.672184 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.672158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:34.772264 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.772233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.772384 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.772299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64hsc\" (UniqueName: \"kubernetes.io/projected/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-api-access-64hsc\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.772433 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:34.772378    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:34.772482 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.772386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-data-volume\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.772482 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:34.772457    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:35.272437636 +0000 UTC m=+273.825673525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:34.772580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.772512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-crio-socket\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.772580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.772540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.772664 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.772630    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-crio-socket\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.772664 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:34.772656    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:34.772757 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.772694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-data-volume\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.772757 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:34.772707    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:35.272695352 +0000 UTC m=+273.825931252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:34.779780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.779756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64hsc\" (UniqueName: \"kubernetes.io/projected/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-api-access-64hsc\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:34.791431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.791397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr" event={"ID":"d0b2eec6-f217-45c6-a4cc-5807f06c9599","Type":"ContainerStarted","Data":"35b8db6da7677c0bdbd172cb2a819ef708980de38f8ee12143b71c207d558f94"}
Jul 11 01:10:34.792953 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.792936    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/0.log"
Jul 11 01:10:34.793071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.792969    2563 generic.go:356] "Generic (PLEG): container finished" podID="a93c01e8-f32f-44f5-a86f-0a8763763fb5" containerID="61288b7c597a5b7adfb086447702f32beaaa5db676c39fb9ffb1cda6fcd14919" exitCode=255
Jul 11 01:10:34.793071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.793040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-q7gph" event={"ID":"a93c01e8-f32f-44f5-a86f-0a8763763fb5","Type":"ContainerDied","Data":"61288b7c597a5b7adfb086447702f32beaaa5db676c39fb9ffb1cda6fcd14919"}
Jul 11 01:10:34.793230 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.793214    2563 scope.go:117] "RemoveContainer" containerID="61288b7c597a5b7adfb086447702f32beaaa5db676c39fb9ffb1cda6fcd14919"
Jul 11 01:10:34.794585 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.794561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v" event={"ID":"eaf40fcb-4027-433e-925f-be826b1e77ed","Type":"ContainerStarted","Data":"157a9e3e28528cac8ff8572ef56fe7510ac679c6dffa200ee7db26da6c6c6f9c"}
Jul 11 01:10:34.805013 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.804970    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr" podStartSLOduration=1.685040085 podStartE2EDuration="4.804958542s" totalImagesPullingTime="3.119918457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:34.804765236 +0000 UTC m=+273.358001145" watchObservedRunningTime="2026-07-11 01:10:34.804958542 +0000 UTC m=+273.358194497"
Jul 11 01:10:34.834414 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:34.834366    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v" podStartSLOduration=1.493502232 podStartE2EDuration="4.834349186s" totalImagesPullingTime="3.340846954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:34.834014359 +0000 UTC m=+273.387250266" watchObservedRunningTime="2026-07-11 01:10:34.834349186 +0000 UTC m=+273.387585098"
Jul 11 01:10:35.260670 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.260641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:35.277724 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.277704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:35.277855 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.277751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:35.277855 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:35.277829    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:35.277855 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:35.277839    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:35.277946 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:35.277879    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:36.277865741 +0000 UTC m=+274.831101626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:35.277946 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:35.277893    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:36.277886912 +0000 UTC m=+274.831122796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:35.361382 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.361349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:35.461485 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.461456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:35.779823 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.779777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:35.798737 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.798714    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/1.log"
Jul 11 01:10:35.799101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.799083    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/0.log"
Jul 11 01:10:35.799167 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.799117    2563 generic.go:356] "Generic (PLEG): container finished" podID="a93c01e8-f32f-44f5-a86f-0a8763763fb5" containerID="10a0b1acfdca1afc890b4f4a962205f1ee1013c4da2d0516d4beee24a0c35a32" exitCode=255
Jul 11 01:10:35.799167 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.799150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-q7gph" event={"ID":"a93c01e8-f32f-44f5-a86f-0a8763763fb5","Type":"ContainerDied","Data":"10a0b1acfdca1afc890b4f4a962205f1ee1013c4da2d0516d4beee24a0c35a32"}
Jul 11 01:10:35.799246 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.799208    2563 scope.go:117] "RemoveContainer" containerID="61288b7c597a5b7adfb086447702f32beaaa5db676c39fb9ffb1cda6fcd14919"
Jul 11 01:10:35.799432 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.799410    2563 scope.go:117] "RemoveContainer" containerID="10a0b1acfdca1afc890b4f4a962205f1ee1013c4da2d0516d4beee24a0c35a32"
Jul 11 01:10:35.799608 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:35.799587    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-q7gph_openshift-console-operator(a93c01e8-f32f-44f5-a86f-0a8763763fb5)\"" pod="openshift-console-operator/console-operator-7866497494-q7gph" podUID="a93c01e8-f32f-44f5-a86f-0a8763763fb5"
Jul 11 01:10:35.830505 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:35.830479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:36.053054 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.052955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:36.153418 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.153394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:36.259123 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.259099    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"]
Jul 11 01:10:36.263481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.263464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"
Jul 11 01:10:36.265697 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.265660    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 11 01:10:36.265831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.265811    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 11 01:10:36.266420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.266408    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r7h99\""
Jul 11 01:10:36.269147 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.269128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"]
Jul 11 01:10:36.284173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.284152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:36.284257 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.284189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:36.284295 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:36.284270    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:36.284295 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:36.284290    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:36.284360 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:36.284324    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.284310937 +0000 UTC m=+276.837546822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:36.284360 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:36.284336    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.28433012 +0000 UTC m=+276.837566005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:36.301808 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.301786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:36.350790 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.350723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:36.384587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.384564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsw57\" (UniqueName: \"kubernetes.io/projected/a3628e00-1e0b-4689-8293-3046a82c83b4-kube-api-access-vsw57\") pod \"migrator-7f59b54f6c-pjmqz\" (UID: \"a3628e00-1e0b-4689-8293-3046a82c83b4\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"
Jul 11 01:10:36.485989 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.485957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsw57\" (UniqueName: \"kubernetes.io/projected/a3628e00-1e0b-4689-8293-3046a82c83b4-kube-api-access-vsw57\") pod \"migrator-7f59b54f6c-pjmqz\" (UID: \"a3628e00-1e0b-4689-8293-3046a82c83b4\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"
Jul 11 01:10:36.493434 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.493409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsw57\" (UniqueName: \"kubernetes.io/projected/a3628e00-1e0b-4689-8293-3046a82c83b4-kube-api-access-vsw57\") pod \"migrator-7f59b54f6c-pjmqz\" (UID: \"a3628e00-1e0b-4689-8293-3046a82c83b4\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"
Jul 11 01:10:36.572708 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.572672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"
Jul 11 01:10:36.707225 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.707190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz"]
Jul 11 01:10:36.710305 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:10:36.710278    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3628e00_1e0b_4689_8293_3046a82c83b4.slice/crio-9996a559f32fdd2467999033010c77a181696fe861aea3a6419e07b19bba8d72 WatchSource:0}: Error finding container 9996a559f32fdd2467999033010c77a181696fe861aea3a6419e07b19bba8d72: Status 404 returned error can't find the container with id 9996a559f32fdd2467999033010c77a181696fe861aea3a6419e07b19bba8d72
Jul 11 01:10:36.760570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.760549    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wd5tt_d4177f2f-ac39-4e38-8a38-6d4c0903b07b/dns-node-resolver/0.log"
Jul 11 01:10:36.804046 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.804025    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/1.log"
Jul 11 01:10:36.804386 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.804360    2563 scope.go:117] "RemoveContainer" containerID="10a0b1acfdca1afc890b4f4a962205f1ee1013c4da2d0516d4beee24a0c35a32"
Jul 11 01:10:36.804558 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:36.804534    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-q7gph_openshift-console-operator(a93c01e8-f32f-44f5-a86f-0a8763763fb5)\"" pod="openshift-console-operator/console-operator-7866497494-q7gph" podUID="a93c01e8-f32f-44f5-a86f-0a8763763fb5"
Jul 11 01:10:36.805265 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:36.805243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz" event={"ID":"a3628e00-1e0b-4689-8293-3046a82c83b4","Type":"ContainerStarted","Data":"9996a559f32fdd2467999033010c77a181696fe861aea3a6419e07b19bba8d72"}
Jul 11 01:10:37.361126 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:37.361098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2zwrd_aace16b5-8518-46a8-a6fc-96756245cb15/node-ca/0.log"
Jul 11 01:10:37.694449 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:37.694416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:38.200325 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.200294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:38.200744 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:38.200444    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 01:10:38.200744 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:38.200509    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls podName:d2f4909e-9134-44fc-8e02-f749429e3c32 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:46.200491824 +0000 UTC m=+284.753727726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r27n" (UID: "d2f4909e-9134-44fc-8e02-f749429e3c32") : secret "samples-operator-tls" not found
Jul 11 01:10:38.300964 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.300878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:38.300964 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.300945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:38.301145 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:38.301010    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:38.301145 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:38.301033    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:38.301145 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:38.301073    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:42.301059191 +0000 UTC m=+280.854295075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:38.301145 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:38.301088    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:42.301082206 +0000 UTC m=+280.854318091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:38.362493 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.362468    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5fgk_054bdd86-4a49-421e-9e4d-33f7ce248bb4/serve-healthcheck-canary/0.log"
Jul 11 01:10:38.814460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.814428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz" event={"ID":"a3628e00-1e0b-4689-8293-3046a82c83b4","Type":"ContainerStarted","Data":"d8e7b381515cac1f93f888d9c5894036927675a980dc177fecc376ed1af822c8"}
Jul 11 01:10:38.814615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.814475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz" event={"ID":"a3628e00-1e0b-4689-8293-3046a82c83b4","Type":"ContainerStarted","Data":"8c01608435e98b12b507f4e5527a760919b5cf297b06913fe056b30ca765af01"}
Jul 11 01:10:38.833449 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.833406    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pjmqz" podStartSLOduration=1.5406127490000001 podStartE2EDuration="2.833392335s" totalImagesPullingTime="1.292779586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:38.832105224 +0000 UTC m=+277.385341131" watchObservedRunningTime="2026-07-11 01:10:38.833392335 +0000 UTC m=+277.386628242"
Jul 11 01:10:38.871606 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:38.871582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:40.811515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:40.811478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:40.812007 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:40.811544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:10:40.812007 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:40.811972    2563 scope.go:117] "RemoveContainer" containerID="10a0b1acfdca1afc890b4f4a962205f1ee1013c4da2d0516d4beee24a0c35a32"
Jul 11 01:10:40.812176 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:40.812154    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-q7gph_openshift-console-operator(a93c01e8-f32f-44f5-a86f-0a8763763fb5)\"" pod="openshift-console-operator/console-operator-7866497494-q7gph" podUID="a93c01e8-f32f-44f5-a86f-0a8763763fb5"
Jul 11 01:10:41.172716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:41.172664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:41.389317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:41.389282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:41.514319 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:41.514245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:41.652491 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:41.652460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:41.758932 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:41.758902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:41.858075 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:41.857998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:41.954289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:41.954259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:42.282597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:42.282565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:42.331287 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:42.331262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:42.331389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:42.331302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:42.331389 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:42.331371    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:42.331531 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:42.331507    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:42.331765 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:42.331746    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:50.331721446 +0000 UTC m=+288.884957335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:42.331885 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:42.331870    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:10:50.331851555 +0000 UTC m=+288.885087441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:42.679243 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:42.679200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:43.281592 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:43.281559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:43.522719 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:43.522673    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3"
Jul 11 01:10:43.522719 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:43.522671    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vdcrx" podUID="3c8a94a0-f9a2-42d3-bab2-af5d8084a562"
Jul 11 01:10:43.829653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:43.829624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:10:43.829849 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:43.829624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:10:43.880014 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:43.879988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:44.084874 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:44.084799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:44.282677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:44.282649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:44.333512 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:44.333477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:44.517537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:44.517508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:44.676924 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:44.676892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:44.876219 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:44.876191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:45.275383 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:45.275302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:45.376054 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:45.376022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:45.427091 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:45.427067    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:45.679414 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:45.679384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:46.078637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.078541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:46.263201 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.263172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:46.265515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.265490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2f4909e-9134-44fc-8e02-f749429e3c32-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r27n\" (UID: \"d2f4909e-9134-44fc-8e02-f749429e3c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:46.279695 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.279649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:46.398932 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.398906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"
Jul 11 01:10:46.518471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.518444    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n"]
Jul 11 01:10:46.767349 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.767272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:10:46.767349 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.767310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:10:46.769504 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.769480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8a94a0-f9a2-42d3-bab2-af5d8084a562-metrics-tls\") pod \"dns-default-vdcrx\" (UID: \"3c8a94a0-f9a2-42d3-bab2-af5d8084a562\") " pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:10:46.769629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.769611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"image-registry-8c4ff965c-kg2cp\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") " pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:10:46.833051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.833023    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzrhh\""
Jul 11 01:10:46.833051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.833023    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fljvr\""
Jul 11 01:10:46.838820 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.838794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n" event={"ID":"d2f4909e-9134-44fc-8e02-f749429e3c32","Type":"ContainerStarted","Data":"f58aec8d2643dc0926d7853b814c61ca87d08f07a884c4ce7052bad423eb32e5"}
Jul 11 01:10:46.840978 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.840962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:10:46.841039 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.840981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:10:46.868435 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.868407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:10:46.868550 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:46.868529    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 01:10:46.868614 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:46.868603    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert podName:c687634c-5588-4dc9-abe3-44ec590658eb nodeName:}" failed. No retries permitted until 2026-07-11 01:12:48.868586574 +0000 UTC m=+407.421822474 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-25tfx" (UID: "c687634c-5588-4dc9-abe3-44ec590658eb") : secret "networking-console-plugin-cert" not found
Jul 11 01:10:46.880074 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.880015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:46.969526 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.969495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vdcrx"]
Jul 11 01:10:46.972142 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:10:46.972116    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8a94a0_f9a2_42d3_bab2_af5d8084a562.slice/crio-adec8113bf92510369130399d122ed29048c5204a7a674b5972a22a2a10e8f45 WatchSource:0}: Error finding container adec8113bf92510369130399d122ed29048c5204a7a674b5972a22a2a10e8f45: Status 404 returned error can't find the container with id adec8113bf92510369130399d122ed29048c5204a7a674b5972a22a2a10e8f45
Jul 11 01:10:46.985432 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:46.985410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8c4ff965c-kg2cp"]
Jul 11 01:10:46.987946 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:10:46.987922    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6110e1bf_737f_4ddf_9e71_c62577be85c3.slice/crio-ff25ab239900ece1cc40cf693966b93d119be1c7c5d901e1a845f93c0e36ef5e WatchSource:0}: Error finding container ff25ab239900ece1cc40cf693966b93d119be1c7c5d901e1a845f93c0e36ef5e: Status 404 returned error can't find the container with id ff25ab239900ece1cc40cf693966b93d119be1c7c5d901e1a845f93c0e36ef5e
Jul 11 01:10:47.277855 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.277772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:47.688334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.688283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:47.794208 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.794123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:47.843764 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.843723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vdcrx" event={"ID":"3c8a94a0-f9a2-42d3-bab2-af5d8084a562","Type":"ContainerStarted","Data":"adec8113bf92510369130399d122ed29048c5204a7a674b5972a22a2a10e8f45"}
Jul 11 01:10:47.845533 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.845502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" event={"ID":"6110e1bf-737f-4ddf-9e71-c62577be85c3","Type":"ContainerStarted","Data":"f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb"}
Jul 11 01:10:47.845642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.845549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" event={"ID":"6110e1bf-737f-4ddf-9e71-c62577be85c3","Type":"ContainerStarted","Data":"ff25ab239900ece1cc40cf693966b93d119be1c7c5d901e1a845f93c0e36ef5e"}
Jul 11 01:10:47.845642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.845632    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:10:47.960705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:47.960609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:48.098277 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:48.098243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:48.483337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:48.483303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:48.880461 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:48.880427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:49.082998 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.082964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:49.676877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.676841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:49.853929 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.853894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n" event={"ID":"d2f4909e-9134-44fc-8e02-f749429e3c32","Type":"ContainerStarted","Data":"3927f088db4820765c0c0a38e7a7af29e224fb41b69dc1d0b07a6d3179fbfcf1"}
Jul 11 01:10:49.854113 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.853944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n" event={"ID":"d2f4909e-9134-44fc-8e02-f749429e3c32","Type":"ContainerStarted","Data":"ee51db6219b9f130b4a63746226fe3ac510512ee140d9a7ad46073a1ac342fd2"}
Jul 11 01:10:49.855602 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.855578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vdcrx" event={"ID":"3c8a94a0-f9a2-42d3-bab2-af5d8084a562","Type":"ContainerStarted","Data":"0b19d946454b41fc73ed516de5ca3291a48937db95c2fb543c26a985f963bed1"}
Jul 11 01:10:49.855704 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.855617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vdcrx" event={"ID":"3c8a94a0-f9a2-42d3-bab2-af5d8084a562","Type":"ContainerStarted","Data":"1c03eb72e90330512353baded74f97eddee2c276be1e609fafa328b273aee494"}
Jul 11 01:10:49.855746 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.855714    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:10:49.868550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.868509    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" podStartSLOduration=286.868495805 podStartE2EDuration="4m46.868495805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:47.862658593 +0000 UTC m=+286.415894501" watchObservedRunningTime="2026-07-11 01:10:49.868495805 +0000 UTC m=+288.421731712"
Jul 11 01:10:49.868707 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.868666    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r27n" podStartSLOduration=17.295624019 podStartE2EDuration="19.868662424s" totalImagesPullingTime="2.573038405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:49.867935638 +0000 UTC m=+288.421171539" watchObservedRunningTime="2026-07-11 01:10:49.868662424 +0000 UTC m=+288.421898330"
Jul 11 01:10:49.882061 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:49.882023    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vdcrx" podStartSLOduration=251.720509761 podStartE2EDuration="4m13.882008082s" totalImagesPullingTime="2.161498321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:49.881098851 +0000 UTC m=+288.434334765" watchObservedRunningTime="2026-07-11 01:10:49.882008082 +0000 UTC m=+288.435243988"
Jul 11 01:10:50.281214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:50.281183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:50.398309 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:50.398277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:50.398453 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:50.398322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:50.398453 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:50.398427    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:50.398522 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:50.398495    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls podName:43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c nodeName:}" failed. No retries permitted until 2026-07-11 01:11:06.398477458 +0000 UTC m=+304.951713359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpnj5" (UID: "43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:50.398933 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:50.398915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:10:50.508174 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:50.508146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:50.680798 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:50.680767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:51.081464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:51.081388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:51.681296 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:51.681262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:51.884359 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:51.884325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:52.084828 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:52.084747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:53.049948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.049919    2563 scope.go:117] "RemoveContainer" containerID="10a0b1acfdca1afc890b4f4a962205f1ee1013c4da2d0516d4beee24a0c35a32"
Jul 11 01:10:53.664239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.664206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:53.716559 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.716533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:53.868880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.868854    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:10:53.869224 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.869211    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/1.log"
Jul 11 01:10:53.869267 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.869241    2563 generic.go:356] "Generic (PLEG): container finished" podID="a93c01e8-f32f-44f5-a86f-0a8763763fb5" containerID="249888157fe8795b59884607ff3133ec050090ca8524904ed5449e68740a4af3" exitCode=255
Jul 11 01:10:53.869347 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.869292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-q7gph" event={"ID":"a93c01e8-f32f-44f5-a86f-0a8763763fb5","Type":"ContainerDied","Data":"249888157fe8795b59884607ff3133ec050090ca8524904ed5449e68740a4af3"}
Jul 11 01:10:53.869347 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.869338    2563 scope.go:117] "RemoveContainer" containerID="10a0b1acfdca1afc890b4f4a962205f1ee1013c4da2d0516d4beee24a0c35a32"
Jul 11 01:10:53.869633 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:53.869608    2563 scope.go:117] "RemoveContainer" containerID="249888157fe8795b59884607ff3133ec050090ca8524904ed5449e68740a4af3"
Jul 11 01:10:53.869824 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:53.869804    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-q7gph_openshift-console-operator(a93c01e8-f32f-44f5-a86f-0a8763763fb5)\"" pod="openshift-console-operator/console-operator-7866497494-q7gph" podUID="a93c01e8-f32f-44f5-a86f-0a8763763fb5"
Jul 11 01:10:54.050138 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:54.050059    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx" podUID="c687634c-5588-4dc9-abe3-44ec590658eb"
Jul 11 01:10:54.874608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:54.874584    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:10:59.022606 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:59.022570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:59.050239 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:10:59.050205    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fd7vb" podUID="ad78a13b-e32c-49aa-887e-dee668138a07"
Jul 11 01:10:59.116648 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:59.116615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:10:59.860699 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:10:59.860654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vdcrx"
Jul 11 01:11:00.811460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:00.811419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:11:00.811967 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:00.811483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:11:00.811967 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:00.811882    2563 scope.go:117] "RemoveContainer" containerID="249888157fe8795b59884607ff3133ec050090ca8524904ed5449e68740a4af3"
Jul 11 01:11:00.812100 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:00.812071    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-q7gph_openshift-console-operator(a93c01e8-f32f-44f5-a86f-0a8763763fb5)\"" pod="openshift-console-operator/console-operator-7866497494-q7gph" podUID="a93c01e8-f32f-44f5-a86f-0a8763763fb5"
Jul 11 01:11:01.868570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:01.868539    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:11:01.869810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:01.869790    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:11:01.874120 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:01.874097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:11:01.875381 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:01.875359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:11:01.878952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:01.878933    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 11 01:11:05.094723 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:05.094694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:05.195407 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:05.195375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:05.265659 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:05.265624    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:05.720929 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:05.720898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:06.408819 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.408780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:11:06.411198 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.411170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpnj5\" (UID: \"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c\") " pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:11:06.686952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.686872    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4nn2\""
Jul 11 01:11:06.695605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.695588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rpnj5"
Jul 11 01:11:06.817385 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.817356    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rpnj5"]
Jul 11 01:11:06.820231 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:11:06.820202    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f5dc6d_c35d_4ccf_ab16_3c55b5757a3c.slice/crio-315a30d0d478e3d6ce5d2f3d6f4746d993dd452503c36e207096d6cf6e1219ad WatchSource:0}: Error finding container 315a30d0d478e3d6ce5d2f3d6f4746d993dd452503c36e207096d6cf6e1219ad: Status 404 returned error can't find the container with id 315a30d0d478e3d6ce5d2f3d6f4746d993dd452503c36e207096d6cf6e1219ad
Jul 11 01:11:06.821347 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.821330    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:11:06.845405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.845383    2563 patch_prober.go:28] interesting pod/image-registry-8c4ff965c-kg2cp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 11 01:11:06.845492 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.845422    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 01:11:06.915757 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:06.915704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpnj5" event={"ID":"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c","Type":"ContainerStarted","Data":"315a30d0d478e3d6ce5d2f3d6f4746d993dd452503c36e207096d6cf6e1219ad"}
Jul 11 01:11:08.049696 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:08.049648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:11:08.854543 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:08.854517    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:11:08.969938 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:08.969905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:09.122788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:09.122749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:09.223512 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:09.223461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:09.306944 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:09.306905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:09.364738 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:09.364703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:09.555551 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:09.555481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:10.050238 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:10.050191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:11:10.932580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:10.932543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpnj5" event={"ID":"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c","Type":"ContainerStarted","Data":"5a8cf6c74f2a6d1ce9b3dd71e69b8050d83a53b93b603d543083b67ba18b8864"}
Jul 11 01:11:11.938356 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:11.938315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpnj5" event={"ID":"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c","Type":"ContainerStarted","Data":"ae0322b4f25cac8b5410cbce2ac95f9e6c7d8c4197ffe2025efc2ed000f95d21"}
Jul 11 01:11:12.521001 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:12.520951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:12.577134 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:12.577101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:13.096613 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:13.096575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:13.946632 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:13.946595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpnj5" event={"ID":"43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c","Type":"ContainerStarted","Data":"7b5115e39a4c28481f463509a932aeae23209f7b08687dc7f8773c244b63b2b6"}
Jul 11 01:11:13.963346 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:13.963217    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rpnj5" podStartSLOduration=33.184395001 podStartE2EDuration="39.96320122s" totalImagesPullingTime="6.778806219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:10:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:13.962027113 +0000 UTC m=+312.515263016" watchObservedRunningTime="2026-07-11 01:11:13.96320122 +0000 UTC m=+312.516437126"
Jul 11 01:11:14.050468 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:14.050439    2563 scope.go:117] "RemoveContainer" containerID="249888157fe8795b59884607ff3133ec050090ca8524904ed5449e68740a4af3"
Jul 11 01:11:14.951229 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:14.951197    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:11:14.951620 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:14.951330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-q7gph" event={"ID":"a93c01e8-f32f-44f5-a86f-0a8763763fb5","Type":"ContainerStarted","Data":"878a9c149dc434bd0cc8af7ea4997efdf0b0adb6ef6466176b72d5bc87c51589"}
Jul 11 01:11:14.951914 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:14.951876    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:11:14.966996 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:14.966946    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-q7gph" podStartSLOduration=41.85057104 podStartE2EDuration="44.966931258s" totalImagesPullingTime="3.116360218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:14.965308609 +0000 UTC m=+313.518544517" watchObservedRunningTime="2026-07-11 01:11:14.966931258 +0000 UTC m=+313.520167184"
Jul 11 01:11:14.975476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:14.975451    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-q7gph"
Jul 11 01:11:15.150037 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.150000    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-5w7d6"]
Jul 11 01:11:15.153146 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.153125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-5w7d6"
Jul 11 01:11:15.155256 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.155223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 11 01:11:15.155366 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.155299    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 11 01:11:15.155366 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.155302    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ks47s\""
Jul 11 01:11:15.162041 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.162021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-5w7d6"]
Jul 11 01:11:15.167919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.167887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.261837 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.261805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.281007 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.280977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jgm6\" (UniqueName: \"kubernetes.io/projected/3eded54b-c81a-4013-81b0-0bda0b5227e2-kube-api-access-2jgm6\") pod \"downloads-68c9cbb497-5w7d6\" (UID: \"3eded54b-c81a-4013-81b0-0bda0b5227e2\") " pod="openshift-console/downloads-68c9cbb497-5w7d6"
Jul 11 01:11:15.314661 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.314630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.382345 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.382313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jgm6\" (UniqueName: \"kubernetes.io/projected/3eded54b-c81a-4013-81b0-0bda0b5227e2-kube-api-access-2jgm6\") pod \"downloads-68c9cbb497-5w7d6\" (UID: \"3eded54b-c81a-4013-81b0-0bda0b5227e2\") " pod="openshift-console/downloads-68c9cbb497-5w7d6"
Jul 11 01:11:15.400889 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.400816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jgm6\" (UniqueName: \"kubernetes.io/projected/3eded54b-c81a-4013-81b0-0bda0b5227e2-kube-api-access-2jgm6\") pod \"downloads-68c9cbb497-5w7d6\" (UID: \"3eded54b-c81a-4013-81b0-0bda0b5227e2\") " pod="openshift-console/downloads-68c9cbb497-5w7d6"
Jul 11 01:11:15.401908 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.401856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.461823 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.461790    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-5w7d6"
Jul 11 01:11:15.502695 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.502644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.598202 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.598166    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-5w7d6"]
Jul 11 01:11:15.601670 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:11:15.601639    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eded54b_c81a_4013_81b0_0bda0b5227e2.slice/crio-20f868238a47e0e6824750aa5e67cdad25bc2dedfdc72e97e9e84a549a1656ce WatchSource:0}: Error finding container 20f868238a47e0e6824750aa5e67cdad25bc2dedfdc72e97e9e84a549a1656ce: Status 404 returned error can't find the container with id 20f868238a47e0e6824750aa5e67cdad25bc2dedfdc72e97e9e84a549a1656ce
Jul 11 01:11:15.631298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.631266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.655512 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.655446    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"]
Jul 11 01:11:15.659870 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.659852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.662225 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.662205    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 01:11:15.662335 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.662316    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 11 01:11:15.662393 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.662366    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lkrwg\""
Jul 11 01:11:15.662549 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.662535    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 01:11:15.662604 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.662559    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 01:11:15.662648 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.662600    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 11 01:11:15.669070 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.669048    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"]
Jul 11 01:11:15.675698 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.675665    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"]
Jul 11 01:11:15.678786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.678769    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.681425 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.681404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 11 01:11:15.681530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.681469    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nb29b\""
Jul 11 01:11:15.681530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.681485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 11 01:11:15.681718 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.681674    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 11 01:11:15.682086 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.682065    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m87mv"]
Jul 11 01:11:15.685273 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.685254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.687327 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.687309    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-spdn4\""
Jul 11 01:11:15.687412 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.687328    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 01:11:15.687412 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.687382    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 01:11:15.687510 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.687436    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 01:11:15.690605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.690585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"]
Jul 11 01:11:15.712635 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.712611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.772431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.772396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.785580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqq8\" (UniqueName: \"kubernetes.io/projected/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-api-access-hgqq8\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.785580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30c71274-6fb4-4580-a0c0-6991ca12dacf-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.785788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c71274-6fb4-4580-a0c0-6991ca12dacf-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.785788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-accelerators-collector-config\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.785788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5zb\" (UniqueName: \"kubernetes.io/projected/d841e0b8-de13-448a-be12-b50402c1280c-kube-api-access-5s5zb\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.785788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-wtmp\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.785788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8647\" (UniqueName: \"kubernetes.io/projected/4e2fe6bf-f878-4aae-b631-0008348c4d07-kube-api-access-z8647\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.785788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.785987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-tls\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.785987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.785987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-sys\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.785987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d841e0b8-de13-448a-be12-b50402c1280c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.785987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2fe6bf-f878-4aae-b631-0008348c4d07-metrics-client-ca\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.785987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-root\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.785987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.785984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.786218 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.786003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.786218 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.786019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.786218 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.786039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.786218 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.786055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-textfile\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.874238 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.874208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:15.887199 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30c71274-6fb4-4580-a0c0-6991ca12dacf-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.887333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c71274-6fb4-4580-a0c0-6991ca12dacf-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.887333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-accelerators-collector-config\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5zb\" (UniqueName: \"kubernetes.io/projected/d841e0b8-de13-448a-be12-b50402c1280c-kube-api-access-5s5zb\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.887464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-wtmp\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8647\" (UniqueName: \"kubernetes.io/projected/4e2fe6bf-f878-4aae-b631-0008348c4d07-kube-api-access-z8647\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.887597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-tls\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.887597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-sys\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-wtmp\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d841e0b8-de13-448a-be12-b50402c1280c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:15.887610    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2fe6bf-f878-4aae-b631-0008348c4d07-metrics-client-ca\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:15.887666    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-tls podName:4e2fe6bf-f878-4aae-b631-0008348c4d07 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:16.387645951 +0000 UTC m=+314.940881851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-tls") pod "node-exporter-m87mv" (UID: "4e2fe6bf-f878-4aae-b631-0008348c4d07") : secret "node-exporter-tls" not found
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-root\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.887822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.888214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.888214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-textfile\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.888214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqq8\" (UniqueName: \"kubernetes.io/projected/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-api-access-hgqq8\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.888214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-accelerators-collector-config\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.888214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.887609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30c71274-6fb4-4580-a0c0-6991ca12dacf-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.888214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.888060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c71274-6fb4-4580-a0c0-6991ca12dacf-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.888214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.888176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2fe6bf-f878-4aae-b631-0008348c4d07-metrics-client-ca\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.888541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.888324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-root\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.888541 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:15.888409    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 11 01:11:15.888541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.888435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d841e0b8-de13-448a-be12-b50402c1280c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.888541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.888445    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.888541 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:15.888461    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-tls podName:d841e0b8-de13-448a-be12-b50402c1280c nodeName:}" failed. No retries permitted until 2026-07-11 01:11:16.388444733 +0000 UTC m=+314.941680620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-wf8qt" (UID: "d841e0b8-de13-448a-be12-b50402c1280c") : secret "openshift-state-metrics-tls" not found
Jul 11 01:11:15.888541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.888476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-textfile\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.888541 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:15.888543    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 11 01:11:15.888863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.888502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e2fe6bf-f878-4aae-b631-0008348c4d07-sys\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.888863 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:15.888606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-tls podName:30c71274-6fb4-4580-a0c0-6991ca12dacf nodeName:}" failed. No retries permitted until 2026-07-11 01:11:16.388588043 +0000 UTC m=+314.941823941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-2pt4q" (UID: "30c71274-6fb4-4580-a0c0-6991ca12dacf") : secret "kube-state-metrics-tls" not found
Jul 11 01:11:15.890731 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.890707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.890999 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.890978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.891131 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.891110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.903606 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.903584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5zb\" (UniqueName: \"kubernetes.io/projected/d841e0b8-de13-448a-be12-b50402c1280c-kube-api-access-5s5zb\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:15.907203 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.907148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqq8\" (UniqueName: \"kubernetes.io/projected/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-api-access-hgqq8\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:15.907203 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.907169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8647\" (UniqueName: \"kubernetes.io/projected/4e2fe6bf-f878-4aae-b631-0008348c4d07-kube-api-access-z8647\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:15.956224 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.956191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-5w7d6" event={"ID":"3eded54b-c81a-4013-81b0-0bda0b5227e2","Type":"ContainerStarted","Data":"20f868238a47e0e6824750aa5e67cdad25bc2dedfdc72e97e9e84a549a1656ce"}
Jul 11 01:11:15.980896 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:15.980863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.073310 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.073280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.173775 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.173640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.275292 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.275215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.380519 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.380486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.391669 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.391636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-tls\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:16.391849 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.391728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:16.391849 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.391766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:16.394565 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.394540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e2fe6bf-f878-4aae-b631-0008348c4d07-node-exporter-tls\") pod \"node-exporter-m87mv\" (UID: \"4e2fe6bf-f878-4aae-b631-0008348c4d07\") " pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:16.394713 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.394609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30c71274-6fb4-4580-a0c0-6991ca12dacf-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2pt4q\" (UID: \"30c71274-6fb4-4580-a0c0-6991ca12dacf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:16.394840 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.394821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d841e0b8-de13-448a-be12-b50402c1280c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wf8qt\" (UID: \"d841e0b8-de13-448a-be12-b50402c1280c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:16.473208 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.473133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.570134 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.570102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"
Jul 11 01:11:16.573699 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.573432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.588338 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.588314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"
Jul 11 01:11:16.595922 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.595900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m87mv"
Jul 11 01:11:16.674285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.674233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.744094 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.743920    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt"]
Jul 11 01:11:16.746703 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.746663    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:11:16.748614 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:11:16.748529    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd841e0b8_de13_448a_be12_b50402c1280c.slice/crio-fb914d668ac32a2f7fc24a5e78d8c7df020f2e091b377b6a651bcb5171526d11 WatchSource:0}: Error finding container fb914d668ac32a2f7fc24a5e78d8c7df020f2e091b377b6a651bcb5171526d11: Status 404 returned error can't find the container with id fb914d668ac32a2f7fc24a5e78d8c7df020f2e091b377b6a651bcb5171526d11
Jul 11 01:11:16.752872 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.752850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.755610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.755424    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 11 01:11:16.756063 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.756045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 11 01:11:16.756149 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.756062    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 11 01:11:16.756149 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.756050    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 11 01:11:16.756542 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.756522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 11 01:11:16.756852 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.756830    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 11 01:11:16.757040 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.756982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 11 01:11:16.757040 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.756985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 11 01:11:16.757185 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.757089    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 11 01:11:16.757501 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.757424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndq8t\""
Jul 11 01:11:16.768443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.768418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:11:16.773032 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.772971    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2pt4q"]
Jul 11 01:11:16.776493 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:11:16.776443    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c71274_6fb4_4580_a0c0_6991ca12dacf.slice/crio-b232628d8eb9c4549bb7d639c01b12928ade737b6f31043ecb2e85a549b35df5 WatchSource:0}: Error finding container b232628d8eb9c4549bb7d639c01b12928ade737b6f31043ecb2e85a549b35df5: Status 404 returned error can't find the container with id b232628d8eb9c4549bb7d639c01b12928ade737b6f31043ecb2e85a549b35df5
Jul 11 01:11:16.777163 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.777141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:16.795355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795465 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795465 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-out\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqsn\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-kube-api-access-jxqsn\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-volume\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795920 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-web-config\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795920 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795920 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.795920 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.796117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.795942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqsn\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-kube-api-access-jxqsn\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-volume\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897672 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-web-config\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897672 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897672 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897672 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897672 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897934 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897934 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.897934 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.897768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-out\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.898071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:16.897998    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 11 01:11:16.898071 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:16.898055    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls podName:9df2dda8-8e59-41a7-ae0c-362a4d365aab nodeName:}" failed. No retries permitted until 2026-07-11 01:11:17.398036221 +0000 UTC m=+315.951272124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab") : secret "alertmanager-main-tls" not found
Jul 11 01:11:16.898190 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:16.898125    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle podName:9df2dda8-8e59-41a7-ae0c-362a4d365aab nodeName:}" failed. No retries permitted until 2026-07-11 01:11:17.398113554 +0000 UTC m=+315.951349443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab") : configmap references non-existent config key: ca-bundle.crt
Jul 11 01:11:16.899129 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.898773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.899933 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.899623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.900554 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.900514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-volume\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.901071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.901047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.901262 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.901201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.901262 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.901197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.901409 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.901335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-web-config\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.901840 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.901767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.903203 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.903182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-out\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.903626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.903604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.906172 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.906152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqsn\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-kube-api-access-jxqsn\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:16.961135 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.961097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m87mv" event={"ID":"4e2fe6bf-f878-4aae-b631-0008348c4d07","Type":"ContainerStarted","Data":"7e4eff93c8df843b151ced8713d3ebec9555b27063a125acf62e81c6d92daadb"}
Jul 11 01:11:16.962493 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.962459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q" event={"ID":"30c71274-6fb4-4580-a0c0-6991ca12dacf","Type":"ContainerStarted","Data":"b232628d8eb9c4549bb7d639c01b12928ade737b6f31043ecb2e85a549b35df5"}
Jul 11 01:11:16.964503 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.964475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt" event={"ID":"d841e0b8-de13-448a-be12-b50402c1280c","Type":"ContainerStarted","Data":"de6b5a7451a5dd5dcc385bc710faee14d06b6a2c9d243105f72e4df89647248a"}
Jul 11 01:11:16.964611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.964537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt" event={"ID":"d841e0b8-de13-448a-be12-b50402c1280c","Type":"ContainerStarted","Data":"5c5cc5a41479571207f3ccda9f36e922aa89027a339b010e83cf8a6a5d9a71d3"}
Jul 11 01:11:16.964611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.964565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt" event={"ID":"d841e0b8-de13-448a-be12-b50402c1280c","Type":"ContainerStarted","Data":"fb914d668ac32a2f7fc24a5e78d8c7df020f2e091b377b6a651bcb5171526d11"}
Jul 11 01:11:16.988306 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:16.988266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:17.189220 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:17.189181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:17.403294 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:17.403015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:17.403294 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:17.403108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:17.403294 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:17.403232    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 11 01:11:17.403574 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:17.403334    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls podName:9df2dda8-8e59-41a7-ae0c-362a4d365aab nodeName:}" failed. No retries permitted until 2026-07-11 01:11:18.403311649 +0000 UTC m=+316.956547549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab") : secret "alertmanager-main-tls" not found
Jul 11 01:11:17.404123 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:17.404080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:17.482856 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:17.482731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:17.583405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:17.583360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:18.412190 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.412155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:18.414966 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.414941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:18.566469 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.566438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:11:18.587115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.587008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:18.689859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.689815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:18.743891 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.743527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:11:18.745664 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:11:18.745616    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df2dda8_8e59_41a7_ae0c_362a4d365aab.slice/crio-dd00d6f084c25ffc8eb65a0a949b33e3af74c6ce17d954169c89470e31bc61fa WatchSource:0}: Error finding container dd00d6f084c25ffc8eb65a0a949b33e3af74c6ce17d954169c89470e31bc61fa: Status 404 returned error can't find the container with id dd00d6f084c25ffc8eb65a0a949b33e3af74c6ce17d954169c89470e31bc61fa
Jul 11 01:11:18.975546 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.975453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerStarted","Data":"dd00d6f084c25ffc8eb65a0a949b33e3af74c6ce17d954169c89470e31bc61fa"}
Jul 11 01:11:18.977420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.977385    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e2fe6bf-f878-4aae-b631-0008348c4d07" containerID="39b7798013e6e5bc7d478e870c1fac0a73610eb00b52df332b157f2d41ac4829" exitCode=0
Jul 11 01:11:18.977582 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.977423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m87mv" event={"ID":"4e2fe6bf-f878-4aae-b631-0008348c4d07","Type":"ContainerDied","Data":"39b7798013e6e5bc7d478e870c1fac0a73610eb00b52df332b157f2d41ac4829"}
Jul 11 01:11:18.980178 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.980147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q" event={"ID":"30c71274-6fb4-4580-a0c0-6991ca12dacf","Type":"ContainerStarted","Data":"98f5e611d86f50e0960f18ca51650e10c11e91dd1b978d608e8f591c3edd8bee"}
Jul 11 01:11:18.980314 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.980207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q" event={"ID":"30c71274-6fb4-4580-a0c0-6991ca12dacf","Type":"ContainerStarted","Data":"2b882cb5a92f330b52491eafbf7a5317cadf0163c3d01dd20fda14b362b46a58"}
Jul 11 01:11:18.980314 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.980235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q" event={"ID":"30c71274-6fb4-4580-a0c0-6991ca12dacf","Type":"ContainerStarted","Data":"6cda8100637f3e863c06642ac2fc89d3c471b342be4db33261ada1bc56b93657"}
Jul 11 01:11:18.983454 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:18.983414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt" event={"ID":"d841e0b8-de13-448a-be12-b50402c1280c","Type":"ContainerStarted","Data":"2a7c92e1c02bbbb0fb31351fc0a4924f29ccc209914b65ed0711561dbc0efaf8"}
Jul 11 01:11:19.010718 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:19.010516    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-2pt4q" podStartSLOduration=2.255019828 podStartE2EDuration="4.010494954s" totalImagesPullingTime="1.755475126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:19.008602651 +0000 UTC m=+317.561838570" watchObservedRunningTime="2026-07-11 01:11:19.010494954 +0000 UTC m=+317.563730862"
Jul 11 01:11:19.162720 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:19.162671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:19.269301 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:19.269213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:19.991717 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:19.991661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m87mv" event={"ID":"4e2fe6bf-f878-4aae-b631-0008348c4d07","Type":"ContainerStarted","Data":"4ef2a9b2fe7a61ea77eb19c9c285fa40f1e8628474012a3e4e2808275d8be055"}
Jul 11 01:11:19.992121 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:19.991749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m87mv" event={"ID":"4e2fe6bf-f878-4aae-b631-0008348c4d07","Type":"ContainerStarted","Data":"c33c5d37936725e866aaffcf21aed798675b937f0a30f6bd7003f0716a462296"}
Jul 11 01:11:20.014272 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.014217    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wf8qt" podStartSLOduration=3.418099908 podStartE2EDuration="5.014194715s" totalImagesPullingTime="1.596094807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:19.025231041 +0000 UTC m=+317.578466949" watchObservedRunningTime="2026-07-11 01:11:20.014194715 +0000 UTC m=+318.567430622"
Jul 11 01:11:20.014569 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.014530    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m87mv" podStartSLOduration=3.4732469200000002 podStartE2EDuration="5.014520343s" totalImagesPullingTime="1.469444152s" totalInitContainerRuntime="71.829271ms" isStatefulPod=true podCreationTimestamp="2026-07-11 01:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:20.012647294 +0000 UTC m=+318.565883204" watchObservedRunningTime="2026-07-11 01:11:20.014520343 +0000 UTC m=+318.567756252"
Jul 11 01:11:20.439181 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.439126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:20.534342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.534301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:20.584972 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.584927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:20.869417 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.869342    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b5b9fb9c9-zcqwj"]
Jul 11 01:11:20.871438 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.871423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:20.873629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.873606    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 11 01:11:20.873786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.873651    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 11 01:11:20.873786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.873654    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 11 01:11:20.873786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.873707    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 11 01:11:20.874442 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.874427    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 11 01:11:20.874526 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.874459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qcgjm\""
Jul 11 01:11:20.883255 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.883227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5b9fb9c9-zcqwj"]
Jul 11 01:11:20.938519 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.938488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-oauth-config\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:20.938519 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.938522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-service-ca\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:20.938712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.938571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-config\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:20.938712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.938610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-oauth-serving-cert\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:20.938712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.938640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twvs7\" (UniqueName: \"kubernetes.io/projected/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-kube-api-access-twvs7\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:20.938712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.938707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-serving-cert\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:20.998193 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.998159    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerID="4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78" exitCode=0
Jul 11 01:11:20.998193 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:20.998193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78"}
Jul 11 01:11:21.039411 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.039378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-serving-cert\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.040090 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.040047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-oauth-config\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.040219 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.040118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-service-ca\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.046642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.040650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-config\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.046642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.040811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-oauth-serving-cert\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.046642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.041023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twvs7\" (UniqueName: \"kubernetes.io/projected/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-kube-api-access-twvs7\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.046642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.043443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-oauth-serving-cert\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.046642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.044120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-oauth-config\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.046642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.044763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-service-ca\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.046642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.044869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-serving-cert\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.047088 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.046945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-config\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.053363 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.053342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twvs7\" (UniqueName: \"kubernetes.io/projected/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-kube-api-access-twvs7\") pod \"console-7b5b9fb9c9-zcqwj\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") " pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.180883 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.180843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:21.331637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.331607    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5b9fb9c9-zcqwj"]
Jul 11 01:11:21.334718 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:11:21.334624    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8288ab3b_3202_4b3c_a6e3_5b6b511b1ed2.slice/crio-a4d2db868208fa8967da05feb6b96d6c4dd0b9eeb1a05c39ab6767fe275cf4a5 WatchSource:0}: Error finding container a4d2db868208fa8967da05feb6b96d6c4dd0b9eeb1a05c39ab6767fe275cf4a5: Status 404 returned error can't find the container with id a4d2db868208fa8967da05feb6b96d6c4dd0b9eeb1a05c39ab6767fe275cf4a5
Jul 11 01:11:21.345971 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.345950    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8c4ff965c-kg2cp"]
Jul 11 01:11:21.424008 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.423969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:21.527283 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.527187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:21.624253 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.624218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:21.722254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.722213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:21.875541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.875506    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:11:21.877383 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.877353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:21.879185 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.879152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.881621 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.881291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5gt94\""
Jul 11 01:11:21.881621 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.881529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 11 01:11:21.881621 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.881558    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 11 01:11:21.881887 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.881868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 11 01:11:21.881949 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.881868    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4nms626bikndh\""
Jul 11 01:11:21.882133 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.882114    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 11 01:11:21.882223 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.882206    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 11 01:11:21.882299 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.882284    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 11 01:11:21.882380 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.882343    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 11 01:11:21.882430 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.882391    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 11 01:11:21.882534 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.882497    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 11 01:11:21.882980 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.882960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 11 01:11:21.883083 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.883067    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 11 01:11:21.883759 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.883606    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 11 01:11:21.883759 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.883712    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 11 01:11:21.883886 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.883767    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 11 01:11:21.885338 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.885286    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 11 01:11:21.894372 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.894352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:11:21.951879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.951838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952039 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.951892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952039 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.951967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkthf\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-kube-api-access-kkthf\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952162 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952162 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952162 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-config\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952652 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952652 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952652 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952652 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952652 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:21.952907 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:21.952705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.004515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.004458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5b9fb9c9-zcqwj" event={"ID":"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2","Type":"ContainerStarted","Data":"a4d2db868208fa8967da05feb6b96d6c4dd0b9eeb1a05c39ab6767fe275cf4a5"}
Jul 11 01:11:22.053358 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053539 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053539 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053539 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053539 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053539 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkthf\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-kube-api-access-kkthf\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.053810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-config\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054458 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054458 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.053974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054458 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.054165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.054596 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.054458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.056619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.054951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.056619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.055018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.056619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.055367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.056619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.055662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.057372 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.057351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.057957 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.057938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.058769 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.058726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.058871 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.058811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.058871 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.058852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.060668 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.060625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.061273 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.061246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-config\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.061643 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.061591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.061752 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.061713    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.062051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.062005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.062138 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.062047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.062401 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.062379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.066786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.066765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkthf\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-kube-api-access-kkthf\") pod \"prometheus-k8s-0\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.192538 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.192435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:22.368769 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:22.368735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:11:22.375718 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:11:22.375663    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcaa1110_1876_4b19_af7c_33faebd813a6.slice/crio-01b4e1dc0deeffc3a118e93612e6c9880b26727d51b804a09a41da18676c34c2 WatchSource:0}: Error finding container 01b4e1dc0deeffc3a118e93612e6c9880b26727d51b804a09a41da18676c34c2: Status 404 returned error can't find the container with id 01b4e1dc0deeffc3a118e93612e6c9880b26727d51b804a09a41da18676c34c2
Jul 11 01:11:23.011487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:23.011434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerStarted","Data":"95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863"}
Jul 11 01:11:23.013696 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:23.013651    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerID="8a29c873ab648b7fc26279b945c534313863a14cc3861602dc759e4442e01c75" exitCode=0
Jul 11 01:11:23.013805 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:23.013776    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"8a29c873ab648b7fc26279b945c534313863a14cc3861602dc759e4442e01c75"}
Jul 11 01:11:23.013858 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:23.013841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerStarted","Data":"01b4e1dc0deeffc3a118e93612e6c9880b26727d51b804a09a41da18676c34c2"}
Jul 11 01:11:23.662464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:23.662392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:23.712164 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:23.712131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:24.024474 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:24.024315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerStarted","Data":"44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6"}
Jul 11 01:11:24.024474 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:24.024401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerStarted","Data":"36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073"}
Jul 11 01:11:24.024474 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:24.024448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerStarted","Data":"7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2"}
Jul 11 01:11:24.025031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:24.024489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerStarted","Data":"3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522"}
Jul 11 01:11:25.036385 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:25.036328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerStarted","Data":"2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09"}
Jul 11 01:11:25.061773 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:25.061523    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.960755359 podStartE2EDuration="9.061500929s" totalImagesPullingTime="4.069857871s" totalInitContainerRuntime="30.887699ms" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:25.05938663 +0000 UTC m=+323.612622537" watchObservedRunningTime="2026-07-11 01:11:25.061500929 +0000 UTC m=+323.614736835"
Jul 11 01:11:26.735750 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:26.735707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:26.842738 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:26.842710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:27.051144 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:27.050984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerStarted","Data":"a22f70013afdbf28896532cd9ed5417d008b3ea43f2e5c1c304fd8bc54b448a6"}
Jul 11 01:11:27.051144 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:27.051056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerStarted","Data":"d26c66b5c12e24dd8792ddf0ff7b1564844c2dd085044c49e5fd4ce2e8ac4d68"}
Jul 11 01:11:27.053115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:27.053080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5b9fb9c9-zcqwj" event={"ID":"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2","Type":"ContainerStarted","Data":"d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1"}
Jul 11 01:11:27.087653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:27.087247    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b5b9fb9c9-zcqwj" podStartSLOduration=1.6788895099999999 podStartE2EDuration="7.087223762s" totalImagesPullingTime="5.408334252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:27.084842135 +0000 UTC m=+325.638078059" watchObservedRunningTime="2026-07-11 01:11:27.087223762 +0000 UTC m=+325.640459669"
Jul 11 01:11:30.661363 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:30.661328    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:30.716061 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:30.716024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:31.181621 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:31.181572    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:31.181824 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:31.181670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:31.187365 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:31.187341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:32.079526 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:32.079494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:11:33.114699 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:33.114646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:33.161229 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:33.161200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:36.097212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.097175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerStarted","Data":"32fcacd4eb49aff70bab8c8240ca1c72bdddde3e2992c597af6b0d9804aeab7c"}
Jul 11 01:11:36.097720 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.097257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerStarted","Data":"46730187926d63a2dbd01ce7fb4ed299c270ca224436d457e84985daab11692a"}
Jul 11 01:11:36.097720 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.097298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerStarted","Data":"a2d56adf133432fac7b2e50e0629706b0d5bb7472e970364f1ebf7c091a835cf"}
Jul 11 01:11:36.097720 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.097336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerStarted","Data":"306ee2feaa9b9aa72f09fdb8a7ce93adc6cb5b38ba0b15d03706b4d10394dada"}
Jul 11 01:11:36.098759 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.098727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-5w7d6" event={"ID":"3eded54b-c81a-4013-81b0-0bda0b5227e2","Type":"ContainerStarted","Data":"63dd59c3899783713bf647bdb10caf6df9dcb3624999024a35d5f2cfb98756dc"}
Jul 11 01:11:36.099010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.098992    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-5w7d6"
Jul 11 01:11:36.104444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.104421    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-5w7d6"
Jul 11 01:11:36.125027 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.124974    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5640902199999998 podStartE2EDuration="15.124957657s" totalImagesPullingTime="12.533711432s" totalInitContainerRuntime="27.156005ms" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:36.122808747 +0000 UTC m=+334.676044652" watchObservedRunningTime="2026-07-11 01:11:36.124957657 +0000 UTC m=+334.678193563"
Jul 11 01:11:36.137459 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:36.137401    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-5w7d6" podStartSLOduration=0.970851842 podStartE2EDuration="21.137385297s" totalImagesPullingTime="20.166533455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:36.136254602 +0000 UTC m=+334.689490509" watchObservedRunningTime="2026-07-11 01:11:36.137385297 +0000 UTC m=+334.690621244"
Jul 11 01:11:37.193518 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:37.193481    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:11:38.664642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:38.664603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:38.718298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:38.718260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:39.465900 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:39.465862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:39.516096 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:39.516059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:42.495031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:42.494993    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5b9fb9c9-zcqwj"]
Jul 11 01:11:42.497734 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:42.497705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:42.596938 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:42.596899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:43.469495 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:43.469446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:43.515632 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:43.515594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:44.463402 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:44.463364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:44.513811 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:44.513781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:45.141329 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:45.141296    2563 generic.go:356] "Generic (PLEG): container finished" podID="eaf40fcb-4027-433e-925f-be826b1e77ed" containerID="157a9e3e28528cac8ff8572ef56fe7510ac679c6dffa200ee7db26da6c6c6f9c" exitCode=0
Jul 11 01:11:45.141711 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:45.141351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v" event={"ID":"eaf40fcb-4027-433e-925f-be826b1e77ed","Type":"ContainerDied","Data":"157a9e3e28528cac8ff8572ef56fe7510ac679c6dffa200ee7db26da6c6c6f9c"}
Jul 11 01:11:45.141761 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:45.141715    2563 scope.go:117] "RemoveContainer" containerID="157a9e3e28528cac8ff8572ef56fe7510ac679c6dffa200ee7db26da6c6c6f9c"
Jul 11 01:11:46.146368 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.146334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-chx6v" event={"ID":"eaf40fcb-4027-433e-925f-be826b1e77ed","Type":"ContainerStarted","Data":"40cf00f60b5eadd9975043130e7ad292e2f20c9bf49821dd0ccfd9407176f834"}
Jul 11 01:11:46.375117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.375075    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3" containerName="registry" containerID="cri-o://f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb" gracePeriod=30
Jul 11 01:11:46.671221 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.671192    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:11:46.720228 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720147    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-certificates\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720228 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6110e1bf-737f-4ddf-9e71-c62577be85c3-ca-trust-extracted\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720228 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720223    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-trusted-ca\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720292    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rqvc\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-kube-api-access-8rqvc\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720327    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-installation-pull-secrets\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-bound-sa-token\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720496 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720708 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720507    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-image-registry-private-configuration\") pod \"6110e1bf-737f-4ddf-9e71-c62577be85c3\" (UID: \"6110e1bf-737f-4ddf-9e71-c62577be85c3\") "
Jul 11 01:11:46.720772 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720752    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:11:46.720972 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720941    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-trusted-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:46.720972 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.720951    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:11:46.723277 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.723237    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:11:46.723489 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.723468    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-kube-api-access-8rqvc" (OuterVolumeSpecName: "kube-api-access-8rqvc") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "kube-api-access-8rqvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:11:46.723560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.723518    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:11:46.723560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.723543    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:11:46.724234 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.724199    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:11:46.729388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.729366    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6110e1bf-737f-4ddf-9e71-c62577be85c3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6110e1bf-737f-4ddf-9e71-c62577be85c3" (UID: "6110e1bf-737f-4ddf-9e71-c62577be85c3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:11:46.821740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.821703    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-certificates\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:46.821740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.821743    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6110e1bf-737f-4ddf-9e71-c62577be85c3-ca-trust-extracted\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:46.821928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.821761    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rqvc\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-kube-api-access-8rqvc\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:46.821928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.821776    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-installation-pull-secrets\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:46.821928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.821790    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-bound-sa-token\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:46.821928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.821804    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6110e1bf-737f-4ddf-9e71-c62577be85c3-registry-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:46.821928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:46.821817    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6110e1bf-737f-4ddf-9e71-c62577be85c3-image-registry-private-configuration\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:11:47.154164 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.154123    2563 generic.go:356] "Generic (PLEG): container finished" podID="6110e1bf-737f-4ddf-9e71-c62577be85c3" containerID="f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb" exitCode=0
Jul 11 01:11:47.154709 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.154169    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp"
Jul 11 01:11:47.154709 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.154212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" event={"ID":"6110e1bf-737f-4ddf-9e71-c62577be85c3","Type":"ContainerDied","Data":"f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb"}
Jul 11 01:11:47.154709 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.154272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8c4ff965c-kg2cp" event={"ID":"6110e1bf-737f-4ddf-9e71-c62577be85c3","Type":"ContainerDied","Data":"ff25ab239900ece1cc40cf693966b93d119be1c7c5d901e1a845f93c0e36ef5e"}
Jul 11 01:11:47.154709 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.154306    2563 scope.go:117] "RemoveContainer" containerID="f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb"
Jul 11 01:11:47.169872 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.169853    2563 scope.go:117] "RemoveContainer" containerID="f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb"
Jul 11 01:11:47.170439 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:11:47.170415    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb\": container with ID starting with f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb not found: ID does not exist" containerID="f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb"
Jul 11 01:11:47.170533 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.170445    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb"} err="failed to get container status \"f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb\": rpc error: code = NotFound desc = could not find container \"f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb\": container with ID starting with f2efdf8ab8494440f0941a54d7ca04c8d8fbc30515e07140aad25fb0083ab5cb not found: ID does not exist"
Jul 11 01:11:47.180481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.180456    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8c4ff965c-kg2cp"]
Jul 11 01:11:47.185174 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:47.185152    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8c4ff965c-kg2cp"]
Jul 11 01:11:48.057724 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:48.055976    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3" path="/var/lib/kubelet/pods/6110e1bf-737f-4ddf-9e71-c62577be85c3/volumes"
Jul 11 01:11:53.657559 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:53.657521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:11:53.708543 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:11:53.708512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:05.245439 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:05.245348    2563 generic.go:356] "Generic (PLEG): container finished" podID="d0b2eec6-f217-45c6-a4cc-5807f06c9599" containerID="35b8db6da7677c0bdbd172cb2a819ef708980de38f8ee12143b71c207d558f94" exitCode=0
Jul 11 01:12:05.245439 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:05.245388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr" event={"ID":"d0b2eec6-f217-45c6-a4cc-5807f06c9599","Type":"ContainerDied","Data":"35b8db6da7677c0bdbd172cb2a819ef708980de38f8ee12143b71c207d558f94"}
Jul 11 01:12:05.245863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:05.245643    2563 scope.go:117] "RemoveContainer" containerID="35b8db6da7677c0bdbd172cb2a819ef708980de38f8ee12143b71c207d558f94"
Jul 11 01:12:06.251072 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:06.251042    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ntsgr" event={"ID":"d0b2eec6-f217-45c6-a4cc-5807f06c9599","Type":"ContainerStarted","Data":"c1a1297e053e3d92fc7e351640abae5202a73497746470194f4bc1362e4e017d"}
Jul 11 01:12:07.522236 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.522191    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b5b9fb9c9-zcqwj" podUID="8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" containerName="console" containerID="cri-o://d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1" gracePeriod=15
Jul 11 01:12:07.809543 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.809516    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:12:07.919344 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.919309    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-oauth-config\") pod \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") "
Jul 11 01:12:07.919344 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.919349    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-service-ca\") pod \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") "
Jul 11 01:12:07.919587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.919385    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-serving-cert\") pod \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") "
Jul 11 01:12:07.919587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.919557    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twvs7\" (UniqueName: \"kubernetes.io/projected/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-kube-api-access-twvs7\") pod \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") "
Jul 11 01:12:07.919727 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.919646    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-config\") pod \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") "
Jul 11 01:12:07.919727 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.919674    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-oauth-serving-cert\") pod \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\" (UID: \"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2\") "
Jul 11 01:12:07.919821 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.919729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-service-ca" (OuterVolumeSpecName: "service-ca") pod "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" (UID: "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:07.920038 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.920013    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:07.920038 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.920009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-config" (OuterVolumeSpecName: "console-config") pod "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" (UID: "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:07.920218 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.920073    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" (UID: "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:07.921786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.921759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" (UID: "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:07.922009 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.921991    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" (UID: "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:07.922058 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:07.922014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-kube-api-access-twvs7" (OuterVolumeSpecName: "kube-api-access-twvs7") pod "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" (UID: "8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2"). InnerVolumeSpecName "kube-api-access-twvs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:12:08.020675 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.020638    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-oauth-config\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:08.020675 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.020668    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-serving-cert\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:08.020675 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.020678    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twvs7\" (UniqueName: \"kubernetes.io/projected/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-kube-api-access-twvs7\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:08.020917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.020712    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-console-config\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:08.020917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.020720    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2-oauth-serving-cert\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:08.260219 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.260184    2563 generic.go:356] "Generic (PLEG): container finished" podID="8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" containerID="d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1" exitCode=0
Jul 11 01:12:08.260377 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.260226    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5b9fb9c9-zcqwj"
Jul 11 01:12:08.260377 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.260252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5b9fb9c9-zcqwj" event={"ID":"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2","Type":"ContainerDied","Data":"d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1"}
Jul 11 01:12:08.260377 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.260294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5b9fb9c9-zcqwj" event={"ID":"8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2","Type":"ContainerDied","Data":"a4d2db868208fa8967da05feb6b96d6c4dd0b9eeb1a05c39ab6767fe275cf4a5"}
Jul 11 01:12:08.260377 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.260312    2563 scope.go:117] "RemoveContainer" containerID="d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1"
Jul 11 01:12:08.268608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.268589    2563 scope.go:117] "RemoveContainer" containerID="d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1"
Jul 11 01:12:08.268845 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:08.268825    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1\": container with ID starting with d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1 not found: ID does not exist" containerID="d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1"
Jul 11 01:12:08.268919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.268851    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1"} err="failed to get container status \"d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1\": rpc error: code = NotFound desc = could not find container \"d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1\": container with ID starting with d3d8cec8154921331e6d6a79ca1defc27cf0ec4d34b1c89a980062b9399ff1c1 not found: ID does not exist"
Jul 11 01:12:08.274305 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.274284    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5b9fb9c9-zcqwj"]
Jul 11 01:12:08.279933 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:08.279911    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b5b9fb9c9-zcqwj"]
Jul 11 01:12:10.054905 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:10.054871    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" path="/var/lib/kubelet/pods/8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2/volumes"
Jul 11 01:12:15.892224 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:15.892186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:12:15.894545 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:15.894525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad78a13b-e32c-49aa-887e-dee668138a07-metrics-certs\") pod \"network-metrics-daemon-fd7vb\" (UID: \"ad78a13b-e32c-49aa-887e-dee668138a07\") " pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:12:16.053051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:16.053025    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ms55\""
Jul 11 01:12:16.061738 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:16.061714    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd7vb"
Jul 11 01:12:16.217039 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:16.217006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fd7vb"]
Jul 11 01:12:16.220630 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:12:16.220603    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad78a13b_e32c_49aa_887e_dee668138a07.slice/crio-80721c7e3193a01a244f6aa74c3035a624254301d4e505b08d013781be47911b WatchSource:0}: Error finding container 80721c7e3193a01a244f6aa74c3035a624254301d4e505b08d013781be47911b: Status 404 returned error can't find the container with id 80721c7e3193a01a244f6aa74c3035a624254301d4e505b08d013781be47911b
Jul 11 01:12:16.294755 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:16.294717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd7vb" event={"ID":"ad78a13b-e32c-49aa-887e-dee668138a07","Type":"ContainerStarted","Data":"80721c7e3193a01a244f6aa74c3035a624254301d4e505b08d013781be47911b"}
Jul 11 01:12:18.306230 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:18.306191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd7vb" event={"ID":"ad78a13b-e32c-49aa-887e-dee668138a07","Type":"ContainerStarted","Data":"a21fd7811f7e40fad08c03d41eace71e4d060e715a8e5563a63fc06a4cc4b1c4"}
Jul 11 01:12:18.306585 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:18.306250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd7vb" event={"ID":"ad78a13b-e32c-49aa-887e-dee668138a07","Type":"ContainerStarted","Data":"95b3c6c7e2fd830166da5e6f9957d17fe2634916c6bd7e97e9fd35bc53f997f3"}
Jul 11 01:12:18.321428 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:18.321369    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fd7vb" podStartSLOduration=374.69526719 podStartE2EDuration="6m16.321346848s" totalImagesPullingTime="1.626079658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:18.320749854 +0000 UTC m=+376.873985761" watchObservedRunningTime="2026-07-11 01:12:18.321346848 +0000 UTC m=+376.874582755"
Jul 11 01:12:18.403985 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:18.403954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:18.453301 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:18.453270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:22.193279 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:22.193243    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:22.266873 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:22.266845    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:22.338095 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:22.338069    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:33.049462 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:33.049418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:33.100562 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:33.100524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:34.850606 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:34.850572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:35.061408 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.061370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:35.901358 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.901326    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:12:35.901761 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.901606    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="alertmanager" containerID="cri-o://95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863" gracePeriod=120
Jul 11 01:12:35.901761 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.901646    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-metric" containerID="cri-o://44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6" gracePeriod=120
Jul 11 01:12:35.901895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.901738    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="prom-label-proxy" containerID="cri-o://2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09" gracePeriod=120
Jul 11 01:12:35.901895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.901785    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="config-reloader" containerID="cri-o://3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522" gracePeriod=120
Jul 11 01:12:35.901895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.901738    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-web" containerID="cri-o://7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2" gracePeriod=120
Jul 11 01:12:35.901895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:35.901789    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy" containerID="cri-o://36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073" gracePeriod=120
Jul 11 01:12:36.380455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380419    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerID="2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09" exitCode=0
Jul 11 01:12:36.380455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380448    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerID="44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6" exitCode=0
Jul 11 01:12:36.380455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380455    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerID="36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073" exitCode=0
Jul 11 01:12:36.380455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380461    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerID="3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522" exitCode=0
Jul 11 01:12:36.380455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380465    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerID="95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863" exitCode=0
Jul 11 01:12:36.380780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09"}
Jul 11 01:12:36.380780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6"}
Jul 11 01:12:36.380780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073"}
Jul 11 01:12:36.380780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522"}
Jul 11 01:12:36.380780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:36.380654    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863"}
Jul 11 01:12:37.140569 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.140542    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.165101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-cluster-tls-config\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165272 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165112    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-metrics-client-ca\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165272 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165132    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165272 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165272 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165187    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-volume\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165490 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165329    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-main-db\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165490 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165376    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-tls-assets\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165490 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165414    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.165868 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165536    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:37.165868 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165643    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.165980    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-web-config\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.166020    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-out\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.166417    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-web\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.166953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxqsn\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-kube-api-access-jxqsn\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.166076    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.168087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\" (UID: \"9df2dda8-8e59-41a7-ae0c-362a4d365aab\") "
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.168361    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-main-db\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.168379    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-metrics-client-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.168392    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df2dda8-8e59-41a7-ae0c-362a4d365aab-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.169948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.169443    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-volume" (OuterVolumeSpecName: "config-volume") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:37.173605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.170859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-out" (OuterVolumeSpecName: "config-out") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:12:37.173605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.170929    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:37.173605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.170994    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:12:37.173605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.172209    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:37.173605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.172217    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-kube-api-access-jxqsn" (OuterVolumeSpecName: "kube-api-access-jxqsn") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "kube-api-access-jxqsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:12:37.173605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.173307    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:37.174895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.174854    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:37.175825 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.175801    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:37.190105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.190072    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-web-config" (OuterVolumeSpecName: "web-config") pod "9df2dda8-8e59-41a7-ae0c-362a4d365aab" (UID: "9df2dda8-8e59-41a7-ae0c-362a4d365aab"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269430    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269459    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-cluster-tls-config\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269469    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-main-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269478    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-volume\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269489    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-tls-assets\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269497    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269505    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-web-config\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269512    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9df2dda8-8e59-41a7-ae0c-362a4d365aab-config-out\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269520    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9df2dda8-8e59-41a7-ae0c-362a4d365aab-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.269924 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.269528    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxqsn\" (UniqueName: \"kubernetes.io/projected/9df2dda8-8e59-41a7-ae0c-362a4d365aab-kube-api-access-jxqsn\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:37.387416 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.387374    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerID="7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2" exitCode=0
Jul 11 01:12:37.387581 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.387429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2"}
Jul 11 01:12:37.387581 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.387468    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.387581 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.387498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9df2dda8-8e59-41a7-ae0c-362a4d365aab","Type":"ContainerDied","Data":"dd00d6f084c25ffc8eb65a0a949b33e3af74c6ce17d954169c89470e31bc61fa"}
Jul 11 01:12:37.387581 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.387543    2563 scope.go:117] "RemoveContainer" containerID="2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09"
Jul 11 01:12:37.396149 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.396058    2563 scope.go:117] "RemoveContainer" containerID="44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6"
Jul 11 01:12:37.403242 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.403224    2563 scope.go:117] "RemoveContainer" containerID="36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073"
Jul 11 01:12:37.410809 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.410789    2563 scope.go:117] "RemoveContainer" containerID="7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2"
Jul 11 01:12:37.410972 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.410949    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:12:37.415011 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.414985    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:12:37.417806 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.417793    2563 scope.go:117] "RemoveContainer" containerID="3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522"
Jul 11 01:12:37.424785 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.424767    2563 scope.go:117] "RemoveContainer" containerID="95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863"
Jul 11 01:12:37.431991 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.431974    2563 scope.go:117] "RemoveContainer" containerID="4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78"
Jul 11 01:12:37.441495 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441477    2563 scope.go:117] "RemoveContainer" containerID="2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09"
Jul 11 01:12:37.441575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441497    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:12:37.441813 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:37.441792    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09\": container with ID starting with 2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09 not found: ID does not exist" containerID="2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09"
Jul 11 01:12:37.441877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441823    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09"} err="failed to get container status \"2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09\": rpc error: code = NotFound desc = could not find container \"2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09\": container with ID starting with 2ab02c8dd30a118750a028f93f4d52159644f8f3cc32ec1c8e98c418788e0d09 not found: ID does not exist"
Jul 11 01:12:37.441877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441842    2563 scope.go:117] "RemoveContainer" containerID="44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6"
Jul 11 01:12:37.441877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441859    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="prom-label-proxy"
Jul 11 01:12:37.441877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441871    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="prom-label-proxy"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441883    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" containerName="console"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441889    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" containerName="console"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441901    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-web"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441909    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-web"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441922    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="init-config-reloader"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441929    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="init-config-reloader"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441941    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="alertmanager"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441949    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="alertmanager"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441959    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441967    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441988    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="config-reloader"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.441996    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="config-reloader"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442007    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3" containerName="registry"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442015    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3" containerName="registry"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442025    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-metric"
Jul 11 01:12:37.442052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442033    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-metric"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:37.442083    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6\": container with ID starting with 44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6 not found: ID does not exist" containerID="44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442101    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-metric"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442111    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="alertmanager"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442125    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy-web"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442132    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6110e1bf-737f-4ddf-9e71-c62577be85c3" containerName="registry"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442137    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="kube-rbac-proxy"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442142    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="prom-label-proxy"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442148    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8288ab3b-3202-4b3c-a6e3-5b6b511b1ed2" containerName="console"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442153    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" containerName="config-reloader"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442103    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6"} err="failed to get container status \"44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6\": rpc error: code = NotFound desc = could not find container \"44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6\": container with ID starting with 44fec5657d2885ff801d6255242386c8d2c4da8427b2dc42da2ffc3dc36036e6 not found: ID does not exist"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442178    2563 scope.go:117] "RemoveContainer" containerID="36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:37.442390    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073\": container with ID starting with 36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073 not found: ID does not exist" containerID="36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442410    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073"} err="failed to get container status \"36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073\": rpc error: code = NotFound desc = could not find container \"36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073\": container with ID starting with 36bc024839dd82810364b940a9587746fe8887626f51b48b2fc0d6fce43ba073 not found: ID does not exist"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442423    2563 scope.go:117] "RemoveContainer" containerID="7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:37.442613    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2\": container with ID starting with 7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2 not found: ID does not exist" containerID="7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442628    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2"} err="failed to get container status \"7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2\": rpc error: code = NotFound desc = could not find container \"7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2\": container with ID starting with 7aa85088de4226478f25637fbfccc81ea56a4a086184a9ac4deaa3668afd40d2 not found: ID does not exist"
Jul 11 01:12:37.442645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442639    2563 scope.go:117] "RemoveContainer" containerID="3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522"
Jul 11 01:12:37.443388 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:37.442873    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522\": container with ID starting with 3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522 not found: ID does not exist" containerID="3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522"
Jul 11 01:12:37.443388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442906    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522"} err="failed to get container status \"3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522\": rpc error: code = NotFound desc = could not find container \"3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522\": container with ID starting with 3058b9483faea47a04235ba1c9158683597308ca864ade81c98fd5a7a660e522 not found: ID does not exist"
Jul 11 01:12:37.443388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.442957    2563 scope.go:117] "RemoveContainer" containerID="95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863"
Jul 11 01:12:37.443388 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:37.443225    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863\": container with ID starting with 95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863 not found: ID does not exist" containerID="95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863"
Jul 11 01:12:37.443388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.443245    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863"} err="failed to get container status \"95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863\": rpc error: code = NotFound desc = could not find container \"95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863\": container with ID starting with 95f0114b4ff8c87ab2fc9b2b96d7b5e15d38c3ff81cb1e8c6001a99de29dc863 not found: ID does not exist"
Jul 11 01:12:37.443388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.443261    2563 scope.go:117] "RemoveContainer" containerID="4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78"
Jul 11 01:12:37.443642 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:12:37.443594    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78\": container with ID starting with 4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78 not found: ID does not exist" containerID="4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78"
Jul 11 01:12:37.443642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.443618    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78"} err="failed to get container status \"4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78\": rpc error: code = NotFound desc = could not find container \"4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78\": container with ID starting with 4f53a4cf5fbc6d053d6cb9b28b9af3fd96b7fb76fe6854af572fdc85f7ab0d78 not found: ID does not exist"
Jul 11 01:12:37.446133 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.446118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.448476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448460    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 11 01:12:37.448580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448514    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 11 01:12:37.448580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448530    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 11 01:12:37.448580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448547    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 11 01:12:37.448580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448572    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 11 01:12:37.448938 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448842    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 11 01:12:37.448938 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448852    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 11 01:12:37.448938 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448915    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 11 01:12:37.449048 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.448953    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndq8t\""
Jul 11 01:12:37.453303 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.453187    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 11 01:12:37.457375 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.457355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:12:37.471009 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.470985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471098 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfe935d-85b6-4945-b5a1-c806b1907083-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471098 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471098 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cfe935d-85b6-4945-b5a1-c806b1907083-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471190 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471190 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cfe935d-85b6-4945-b5a1-c806b1907083-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471190 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-web-config\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471279 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471193    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471279 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cfe935d-85b6-4945-b5a1-c806b1907083-config-out\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471279 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cfe935d-85b6-4945-b5a1-c806b1907083-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471279 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5w5x\" (UniqueName: \"kubernetes.io/projected/3cfe935d-85b6-4945-b5a1-c806b1907083-kube-api-access-d5w5x\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.471455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.471364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.572829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cfe935d-85b6-4945-b5a1-c806b1907083-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.572829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.572829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5w5x\" (UniqueName: \"kubernetes.io/projected/3cfe935d-85b6-4945-b5a1-c806b1907083-kube-api-access-d5w5x\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573118 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573118 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573118 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfe935d-85b6-4945-b5a1-c806b1907083-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573118 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573311 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cfe935d-85b6-4945-b5a1-c806b1907083-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573311 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.572977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cfe935d-85b6-4945-b5a1-c806b1907083-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573412 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573519 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cfe935d-85b6-4945-b5a1-c806b1907083-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573651 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-web-config\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573823 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.573950 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cfe935d-85b6-4945-b5a1-c806b1907083-config-out\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.574079 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cfe935d-85b6-4945-b5a1-c806b1907083-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.574181 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.573883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfe935d-85b6-4945-b5a1-c806b1907083-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576068 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576156 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cfe935d-85b6-4945-b5a1-c806b1907083-config-out\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cfe935d-85b6-4945-b5a1-c806b1907083-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.576649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.576616    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.577583 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.577558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cfe935d-85b6-4945-b5a1-c806b1907083-web-config\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.579579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.579562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5w5x\" (UniqueName: \"kubernetes.io/projected/3cfe935d-85b6-4945-b5a1-c806b1907083-kube-api-access-d5w5x\") pod \"alertmanager-main-0\" (UID: \"3cfe935d-85b6-4945-b5a1-c806b1907083\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.756026 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.755989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 01:12:37.891356 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:37.891321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 01:12:37.894200 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:12:37.894169    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfe935d_85b6_4945_b5a1_c806b1907083.slice/crio-701838d8508c0f10e031eb13453172f4117afde8b72e56d3ca9c0786a4d6d293 WatchSource:0}: Error finding container 701838d8508c0f10e031eb13453172f4117afde8b72e56d3ca9c0786a4d6d293: Status 404 returned error can't find the container with id 701838d8508c0f10e031eb13453172f4117afde8b72e56d3ca9c0786a4d6d293
Jul 11 01:12:38.054854 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:38.054825    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df2dda8-8e59-41a7-ae0c-362a4d365aab" path="/var/lib/kubelet/pods/9df2dda8-8e59-41a7-ae0c-362a4d365aab/volumes"
Jul 11 01:12:38.393620 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:38.393590    2563 generic.go:356] "Generic (PLEG): container finished" podID="3cfe935d-85b6-4945-b5a1-c806b1907083" containerID="9d1193d03495b627fd44ab927e546cf5d536bfcc312c6e31da50fb998ea71c09" exitCode=0
Jul 11 01:12:38.394036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:38.393639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerDied","Data":"9d1193d03495b627fd44ab927e546cf5d536bfcc312c6e31da50fb998ea71c09"}
Jul 11 01:12:38.394036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:38.393708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerStarted","Data":"701838d8508c0f10e031eb13453172f4117afde8b72e56d3ca9c0786a4d6d293"}
Jul 11 01:12:39.400428 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.400391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerStarted","Data":"f1ee47f438a4e7cde1c5532b09789de4c497f3de782c1cb30bc83c708f92ea4c"}
Jul 11 01:12:39.400917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.400467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerStarted","Data":"ca2582436fe6f51357cfc35431e3a61d8a297af5c234fe1f0caddd9e9d9bc197"}
Jul 11 01:12:39.400917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.400507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerStarted","Data":"f933a337a5ccbf2b1981ddaae919ffb967fb7924d0e6906e5fbdacca6078df74"}
Jul 11 01:12:39.400917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.400552    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerStarted","Data":"a61e5b6a58160fba97a2e4b40d4b43b139178a1fabba0811d0a82f71d6d549db"}
Jul 11 01:12:39.400917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.400593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerStarted","Data":"2a1fa4f03e1c1daa84086f695577bfd43e7638005b5550c71a99fe7def9b0e46"}
Jul 11 01:12:39.400917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.400631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cfe935d-85b6-4945-b5a1-c806b1907083","Type":"ContainerStarted","Data":"154e2591421165924dfe71ff671df776a6993efe9ba4697f045c654f715ba0ab"}
Jul 11 01:12:39.424421 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.424343    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.405571273 podStartE2EDuration="2.424326036s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.754763ms" isStatefulPod=false podCreationTimestamp="2026-07-11 01:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:39.423202604 +0000 UTC m=+397.976438512" watchObservedRunningTime="2026-07-11 01:12:39.424326036 +0000 UTC m=+397.977561934"
Jul 11 01:12:39.934676 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.934641    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-745848d5bc-4jthw"]
Jul 11 01:12:39.937267 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.937245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.939726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.939468    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 11 01:12:39.939726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.939505    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 11 01:12:39.939726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.939514    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 11 01:12:39.939726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.939539    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 11 01:12:39.939726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.939548    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vw5lz\""
Jul 11 01:12:39.939726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.939588    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 11 01:12:39.945133 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.945098    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 11 01:12:39.950121 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.950098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-745848d5bc-4jthw"]
Jul 11 01:12:39.995257 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-serving-certs-ca-bundle\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.995257 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-telemeter-client-tls\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.995469 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk7kk\" (UniqueName: \"kubernetes.io/projected/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-kube-api-access-nk7kk\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.995469 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-federate-client-tls\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.995469 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-secret-telemeter-client\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.995579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.995579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-metrics-client-ca\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:39.995579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:39.995537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096378 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-secret-telemeter-client\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-metrics-client-ca\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-serving-certs-ca-bundle\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-telemeter-client-tls\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk7kk\" (UniqueName: \"kubernetes.io/projected/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-kube-api-access-nk7kk\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.096788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.096747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-federate-client-tls\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.097372 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.097343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-metrics-client-ca\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.097586 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.097564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-serving-certs-ca-bundle\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.097727 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.097654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.099131 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.099108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.099284 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.099155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-secret-telemeter-client\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.099453 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.099436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-telemeter-client-tls\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.099488 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.099475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-federate-client-tls\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.106378 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.106353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk7kk\" (UniqueName: \"kubernetes.io/projected/c6f8d0b2-0e53-48b5-981a-0354e7dec6d2-kube-api-access-nk7kk\") pod \"telemeter-client-745848d5bc-4jthw\" (UID: \"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2\") " pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.213952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.213871    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:12:40.214175 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.214142    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="prometheus" containerID="cri-o://d26c66b5c12e24dd8792ddf0ff7b1564844c2dd085044c49e5fd4ce2e8ac4d68" gracePeriod=600
Jul 11 01:12:40.214326 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.214164    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="thanos-sidecar" containerID="cri-o://306ee2feaa9b9aa72f09fdb8a7ce93adc6cb5b38ba0b15d03706b4d10394dada" gracePeriod=600
Jul 11 01:12:40.214326 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.214164    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy" containerID="cri-o://46730187926d63a2dbd01ce7fb4ed299c270ca224436d457e84985daab11692a" gracePeriod=600
Jul 11 01:12:40.214326 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.214190    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="config-reloader" containerID="cri-o://a22f70013afdbf28896532cd9ed5417d008b3ea43f2e5c1c304fd8bc54b448a6" gracePeriod=600
Jul 11 01:12:40.214326 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.214234    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://32fcacd4eb49aff70bab8c8240ca1c72bdddde3e2992c597af6b0d9804aeab7c" gracePeriod=600
Jul 11 01:12:40.214326 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.214202    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-web" containerID="cri-o://a2d56adf133432fac7b2e50e0629706b0d5bb7472e970364f1ebf7c091a835cf" gracePeriod=600
Jul 11 01:12:40.249111 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.249086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw"
Jul 11 01:12:40.390629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.390542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-745848d5bc-4jthw"]
Jul 11 01:12:40.398639 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:12:40.398606    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f8d0b2_0e53_48b5_981a_0354e7dec6d2.slice/crio-b536c80f6be309fe7bbb02c96255be9e6aab5051f4324f2951870069e45eacdc WatchSource:0}: Error finding container b536c80f6be309fe7bbb02c96255be9e6aab5051f4324f2951870069e45eacdc: Status 404 returned error can't find the container with id b536c80f6be309fe7bbb02c96255be9e6aab5051f4324f2951870069e45eacdc
Jul 11 01:12:40.409389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409362    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerID="32fcacd4eb49aff70bab8c8240ca1c72bdddde3e2992c597af6b0d9804aeab7c" exitCode=0
Jul 11 01:12:40.409389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409384    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerID="46730187926d63a2dbd01ce7fb4ed299c270ca224436d457e84985daab11692a" exitCode=0
Jul 11 01:12:40.409389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409393    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerID="a2d56adf133432fac7b2e50e0629706b0d5bb7472e970364f1ebf7c091a835cf" exitCode=0
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409399    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerID="306ee2feaa9b9aa72f09fdb8a7ce93adc6cb5b38ba0b15d03706b4d10394dada" exitCode=0
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409406    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerID="a22f70013afdbf28896532cd9ed5417d008b3ea43f2e5c1c304fd8bc54b448a6" exitCode=0
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409411    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerID="d26c66b5c12e24dd8792ddf0ff7b1564844c2dd085044c49e5fd4ce2e8ac4d68" exitCode=0
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"32fcacd4eb49aff70bab8c8240ca1c72bdddde3e2992c597af6b0d9804aeab7c"}
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"46730187926d63a2dbd01ce7fb4ed299c270ca224436d457e84985daab11692a"}
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"a2d56adf133432fac7b2e50e0629706b0d5bb7472e970364f1ebf7c091a835cf"}
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"306ee2feaa9b9aa72f09fdb8a7ce93adc6cb5b38ba0b15d03706b4d10394dada"}
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"a22f70013afdbf28896532cd9ed5417d008b3ea43f2e5c1c304fd8bc54b448a6"}
Jul 11 01:12:40.409918 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.409732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"d26c66b5c12e24dd8792ddf0ff7b1564844c2dd085044c49e5fd4ce2e8ac4d68"}
Jul 11 01:12:40.411743 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.411715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw" event={"ID":"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2","Type":"ContainerStarted","Data":"b536c80f6be309fe7bbb02c96255be9e6aab5051f4324f2951870069e45eacdc"}
Jul 11 01:12:40.477449 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.477417    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:40.601258 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601204    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601258 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601266    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-config-out\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601304    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-web-config\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-grpc-tls\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601348    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-2\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601377    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkthf\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-kube-api-access-kkthf\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-config\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601418    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-trusted-ca-bundle\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-metrics-client-ca\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-tls\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-kubelet-serving-ca-bundle\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601579    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-1\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601614    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-db\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601655    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-kube-rbac-proxy\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-serving-certs-ca-bundle\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-0\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-tls-assets\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-metrics-client-certs\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.601917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.601853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-thanos-prometheus-http-client-file\") pod \"bcaa1110-1876-4b19-af7c-33faebd813a6\" (UID: \"bcaa1110-1876-4b19-af7c-33faebd813a6\") "
Jul 11 01:12:40.602419 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.602145    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.602870 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.602839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:40.604353 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604104    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:12:40.604353 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604160    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.604353 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604205    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.604353 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.604610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604495    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-config-out" (OuterVolumeSpecName: "config-out") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:12:40.604610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604598    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:40.604818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604773    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.604818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604800    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-config" (OuterVolumeSpecName: "config") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.605113 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.604938    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:40.605113 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.605039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:40.605373 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.605343    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-kube-api-access-kkthf" (OuterVolumeSpecName: "kube-api-access-kkthf") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "kube-api-access-kkthf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:12:40.605485 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.605400    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:40.605927 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.605905    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:12:40.606550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.606522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.606617 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.606599    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.606740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.606723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:12:40.607229 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.607211    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.615399 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.615377    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-web-config" (OuterVolumeSpecName: "web-config") pod "bcaa1110-1876-4b19-af7c-33faebd813a6" (UID: "bcaa1110-1876-4b19-af7c-33faebd813a6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:12:40.703060 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703021    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703060 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703055    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703060 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703068    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-db\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703079    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-kube-rbac-proxy\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703092    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703105    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703116    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-tls-assets\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703127    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-metrics-client-certs\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703139    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703152    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703163    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcaa1110-1876-4b19-af7c-33faebd813a6-config-out\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703174    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-web-config\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703186    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-grpc-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703196    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkthf\" (UniqueName: \"kubernetes.io/projected/bcaa1110-1876-4b19-af7c-33faebd813a6-kube-api-access-kkthf\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703208    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-config\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703220    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703233    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-metrics-client-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703246    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bcaa1110-1876-4b19-af7c-33faebd813a6-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:40.703337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:40.703258    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcaa1110-1876-4b19-af7c-33faebd813a6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:12:41.419516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.419474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bcaa1110-1876-4b19-af7c-33faebd813a6","Type":"ContainerDied","Data":"01b4e1dc0deeffc3a118e93612e6c9880b26727d51b804a09a41da18676c34c2"}
Jul 11 01:12:41.420025 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.419562    2563 scope.go:117] "RemoveContainer" containerID="32fcacd4eb49aff70bab8c8240ca1c72bdddde3e2992c597af6b0d9804aeab7c"
Jul 11 01:12:41.420025 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.419494    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.433810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.433783    2563 scope.go:117] "RemoveContainer" containerID="46730187926d63a2dbd01ce7fb4ed299c270ca224436d457e84985daab11692a"
Jul 11 01:12:41.442777 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.442755    2563 scope.go:117] "RemoveContainer" containerID="a2d56adf133432fac7b2e50e0629706b0d5bb7472e970364f1ebf7c091a835cf"
Jul 11 01:12:41.448216 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.448112    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:12:41.451348 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.451320    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:12:41.452199 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.452172    2563 scope.go:117] "RemoveContainer" containerID="306ee2feaa9b9aa72f09fdb8a7ce93adc6cb5b38ba0b15d03706b4d10394dada"
Jul 11 01:12:41.460103 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.460077    2563 scope.go:117] "RemoveContainer" containerID="a22f70013afdbf28896532cd9ed5417d008b3ea43f2e5c1c304fd8bc54b448a6"
Jul 11 01:12:41.468997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.468976    2563 scope.go:117] "RemoveContainer" containerID="d26c66b5c12e24dd8792ddf0ff7b1564844c2dd085044c49e5fd4ce2e8ac4d68"
Jul 11 01:12:41.475342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475315    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:12:41.475859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475839    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-thanos"
Jul 11 01:12:41.475859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475860    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-thanos"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475873    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="thanos-sidecar"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475882    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="thanos-sidecar"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475891    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="init-config-reloader"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475900    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="init-config-reloader"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475911    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="prometheus"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475919    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="prometheus"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475929    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475938    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475958    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-web"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475965    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-web"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475984    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="config-reloader"
Jul 11 01:12:41.475997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.475991    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="config-reloader"
Jul 11 01:12:41.476572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.476072    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-web"
Jul 11 01:12:41.476572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.476085    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="prometheus"
Jul 11 01:12:41.476572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.476093    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="config-reloader"
Jul 11 01:12:41.476572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.476101    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy"
Jul 11 01:12:41.476572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.476110    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="thanos-sidecar"
Jul 11 01:12:41.476572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.476119    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" containerName="kube-rbac-proxy-thanos"
Jul 11 01:12:41.479427 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.479410    2563 scope.go:117] "RemoveContainer" containerID="8a29c873ab648b7fc26279b945c534313863a14cc3861602dc759e4442e01c75"
Jul 11 01:12:41.479783 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.479767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.482357 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482333    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 11 01:12:41.482357 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482346    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 11 01:12:41.482513 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482403    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 11 01:12:41.482513 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 11 01:12:41.482603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482525    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 11 01:12:41.482603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482550    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 11 01:12:41.482603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482596    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 11 01:12:41.482781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 11 01:12:41.482781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482734    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 11 01:12:41.482781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482773    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 11 01:12:41.482911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482803    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 11 01:12:41.482955 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.482944    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 11 01:12:41.483038 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.483021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5gt94\""
Jul 11 01:12:41.483097 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.483064    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 11 01:12:41.483167 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.483072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4nms626bikndh\""
Jul 11 01:12:41.486706 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.486271    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 11 01:12:41.488502 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.488349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 11 01:12:41.492475 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.492456    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:12:41.511610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.511610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.511863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.511863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.511863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nvwq\" (UniqueName: \"kubernetes.io/projected/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-kube-api-access-8nvwq\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.511863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.511863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.511863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-config-out\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-config\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-web-config\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.511997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.512024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.512045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512306 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.512060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512306 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.512079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512306 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.512099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.512306 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.512131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nvwq\" (UniqueName: \"kubernetes.io/projected/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-kube-api-access-8nvwq\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.613829 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-config-out\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-config\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-web-config\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.613980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614609 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614609 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614609 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.614970 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.614897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.616929 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.615795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.616929 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.616384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.616929 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.616891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.617155 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.617138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.617712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.617505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.618738 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.618692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.619778 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.619730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.620665 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.620637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-config\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.621721 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.621677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.621822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.621764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.621822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.621797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.622075 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.622022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-config-out\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.622283 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.622225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nvwq\" (UniqueName: \"kubernetes.io/projected/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-kube-api-access-8nvwq\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.622283 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.622229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.622431 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.622412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.622708 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.622663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.624196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.624179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b2d303-0961-4f01-b0e7-ec1b85f1f6de-web-config\") pod \"prometheus-k8s-0\" (UID: \"07b2d303-0961-4f01-b0e7-ec1b85f1f6de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.794355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.794264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:41.941358 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:41.941327    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 01:12:42.056152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:42.056065    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcaa1110-1876-4b19-af7c-33faebd813a6" path="/var/lib/kubelet/pods/bcaa1110-1876-4b19-af7c-33faebd813a6/volumes"
Jul 11 01:12:42.299487 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:12:42.299452    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b2d303_0961_4f01_b0e7_ec1b85f1f6de.slice/crio-24047b51a61965fd95991aad2d0ff06c08e6219f0d50050787e47360235ff61b WatchSource:0}: Error finding container 24047b51a61965fd95991aad2d0ff06c08e6219f0d50050787e47360235ff61b: Status 404 returned error can't find the container with id 24047b51a61965fd95991aad2d0ff06c08e6219f0d50050787e47360235ff61b
Jul 11 01:12:42.426235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:42.426208    2563 generic.go:356] "Generic (PLEG): container finished" podID="07b2d303-0961-4f01-b0e7-ec1b85f1f6de" containerID="25db1c023a4e20bf1381f85f99429f58131651ebb372a8241b0c426900006d22" exitCode=0
Jul 11 01:12:42.426607 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:42.426287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerDied","Data":"25db1c023a4e20bf1381f85f99429f58131651ebb372a8241b0c426900006d22"}
Jul 11 01:12:42.426607 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:42.426386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerStarted","Data":"24047b51a61965fd95991aad2d0ff06c08e6219f0d50050787e47360235ff61b"}
Jul 11 01:12:42.428085 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:42.428060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw" event={"ID":"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2","Type":"ContainerStarted","Data":"4507f64a2ea3111615bcd4a4de9a86cabf139d24b55e12e12121cfeb11b8802f"}
Jul 11 01:12:43.437982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.437945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerStarted","Data":"b793dee641d854f0a07b58d6838b0414414d24176b55d9a6b90f0a26fa25e7bf"}
Jul 11 01:12:43.438388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.438055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerStarted","Data":"981030c51c2931b0af415ded41ea8c3a5b4f552c991090c14d1e11d4ffa95699"}
Jul 11 01:12:43.438388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.438087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerStarted","Data":"7494fde7a58cd41961eb11367fb0a69f657792b0a29b103d81c86fd4d79c881a"}
Jul 11 01:12:43.438388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.438116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerStarted","Data":"f8a8f2683e3f67faced04b36e024711cd59ef68450ca151c47278164004f3d51"}
Jul 11 01:12:43.438388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.438150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerStarted","Data":"cf50bb8e98e79fba67b63d403e039cf3296ea6ca37e867547c116fe70f1b9f36"}
Jul 11 01:12:43.438388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.438174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b2d303-0961-4f01-b0e7-ec1b85f1f6de","Type":"ContainerStarted","Data":"f911e4008cfe65fafe85382424b66408bcb7205a6da315c5fcd8f956cabe8859"}
Jul 11 01:12:43.440044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.440021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw" event={"ID":"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2","Type":"ContainerStarted","Data":"635013f25aa67153f90a920a623ef167256bba3330f62b27c940e7c6b87fd673"}
Jul 11 01:12:43.440148 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.440070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw" event={"ID":"c6f8d0b2-0e53-48b5-981a-0354e7dec6d2","Type":"ContainerStarted","Data":"6e700250d288092a0b7f9c16b2a61b138331a505816785af9f685c62370ae751"}
Jul 11 01:12:43.467196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.467145    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.44418499 podStartE2EDuration="2.467128982s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.943992ms" isStatefulPod=false podCreationTimestamp="2026-07-11 01:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:43.465565114 +0000 UTC m=+402.018801031" watchObservedRunningTime="2026-07-11 01:12:43.467128982 +0000 UTC m=+402.020364897"
Jul 11 01:12:43.486835 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:43.486785    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-745848d5bc-4jthw" podStartSLOduration=2.555103529 podStartE2EDuration="4.486765129s" totalImagesPullingTime="1.9316616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:43.485333678 +0000 UTC m=+402.038569624" watchObservedRunningTime="2026-07-11 01:12:43.486765129 +0000 UTC m=+402.040001035"
Jul 11 01:12:44.279464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:44.279405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:44.327862 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:44.327828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:46.794504 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:46.794464    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:12:48.880666 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:48.880623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:12:48.883046 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:48.883025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c687634c-5588-4dc9-abe3-44ec590658eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25tfx\" (UID: \"c687634c-5588-4dc9-abe3-44ec590658eb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:12:49.153583 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:49.153503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s9g7s\""
Jul 11 01:12:49.161603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:49.161583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx"
Jul 11 01:12:49.285807 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:49.285784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-25tfx"]
Jul 11 01:12:49.288291 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:12:49.288256    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc687634c_5588_4dc9_abe3_44ec590658eb.slice/crio-b189349ddeb40f7bc4fcf3d989f4aaf2b7e624bcad65014356c72ab024eaf611 WatchSource:0}: Error finding container b189349ddeb40f7bc4fcf3d989f4aaf2b7e624bcad65014356c72ab024eaf611: Status 404 returned error can't find the container with id b189349ddeb40f7bc4fcf3d989f4aaf2b7e624bcad65014356c72ab024eaf611
Jul 11 01:12:49.464794 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:49.464710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx" event={"ID":"c687634c-5588-4dc9-abe3-44ec590658eb","Type":"ContainerStarted","Data":"b189349ddeb40f7bc4fcf3d989f4aaf2b7e624bcad65014356c72ab024eaf611"}
Jul 11 01:12:50.761140 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:50.761107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:50.862602 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:50.862509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:51.476042 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:51.476004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx" event={"ID":"c687634c-5588-4dc9-abe3-44ec590658eb","Type":"ContainerStarted","Data":"c06781bab73114533f262010c2c130cba0ba8c906c4bd33a3b05ba9711b7b6c0"}
Jul 11 01:12:51.491355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:51.491304    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-25tfx" podStartSLOduration=386.179961241 podStartE2EDuration="6m27.491280242s" totalImagesPullingTime="1.311319001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:51.490093075 +0000 UTC m=+410.043328982" watchObservedRunningTime="2026-07-11 01:12:51.491280242 +0000 UTC m=+410.044516147"
Jul 11 01:12:51.576613 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:51.576582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:51.634741 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:51.634707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:54.825718 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:54.825666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:54.874863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:54.874827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:55.023148 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:55.023113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:12:55.072515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:12:55.072480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:13:20.762952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:13:20.762904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:13:20.812389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:13:20.812330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:13:41.794750 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:13:41.794653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:13:41.810058 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:13:41.810029    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:13:42.695786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:13:42.695758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 01:13:50.065177 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:13:50.065131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:13:50.117695 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:13:50.117656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:02.043187 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:02.043154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:02.113978 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:02.113944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:08.698635 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:08.698582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:08.773485 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:08.773457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:09.092581 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:09.092490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:15.250929 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:15.250896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:15.559397 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:15.559313    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:15.610718 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:15.610669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:16.357483 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:16.357449    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:16.458057 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:16.458024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:26.169717 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:26.169666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:26.272283 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:26.272232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:26.326349 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:26.326315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:35.397304 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:35.397268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:14:35.489716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:14:35.489651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:05.047173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:05.047095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:05.832696 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:05.832662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:08.646475 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:08.646443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:08.701934 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:08.701904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:09.939538 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:09.939504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:10.048010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:10.047981    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:10.742808 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:10.742728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:10.842807 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:10.842771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:12.941491 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:12.941462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:13.127058 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.126988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:13.813073 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.813041    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"]
Jul 11 01:15:13.816437 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.816419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:13.818656 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.818637    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 11 01:15:13.819739 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.819723    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nd5fl\""
Jul 11 01:15:13.819834 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.819723    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 11 01:15:13.824897 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.824876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"]
Jul 11 01:15:13.917637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.917608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b99a4c76-6fe6-4411-93fe-4b85bd744e98-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znb7t\" (UID: \"b99a4c76-6fe6-4411-93fe-4b85bd744e98\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:13.917774 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:13.917669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7kz\" (UniqueName: \"kubernetes.io/projected/b99a4c76-6fe6-4411-93fe-4b85bd744e98-kube-api-access-nb7kz\") pod \"cert-manager-cainjector-559cdd8c87-znb7t\" (UID: \"b99a4c76-6fe6-4411-93fe-4b85bd744e98\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:14.019034 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:14.018993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b99a4c76-6fe6-4411-93fe-4b85bd744e98-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znb7t\" (UID: \"b99a4c76-6fe6-4411-93fe-4b85bd744e98\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:14.019383 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:14.019069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7kz\" (UniqueName: \"kubernetes.io/projected/b99a4c76-6fe6-4411-93fe-4b85bd744e98-kube-api-access-nb7kz\") pod \"cert-manager-cainjector-559cdd8c87-znb7t\" (UID: \"b99a4c76-6fe6-4411-93fe-4b85bd744e98\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:14.026902 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:14.026872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b99a4c76-6fe6-4411-93fe-4b85bd744e98-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znb7t\" (UID: \"b99a4c76-6fe6-4411-93fe-4b85bd744e98\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:14.027010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:14.026969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7kz\" (UniqueName: \"kubernetes.io/projected/b99a4c76-6fe6-4411-93fe-4b85bd744e98-kube-api-access-nb7kz\") pod \"cert-manager-cainjector-559cdd8c87-znb7t\" (UID: \"b99a4c76-6fe6-4411-93fe-4b85bd744e98\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:14.138118 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:14.138095    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"
Jul 11 01:15:14.259210 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:14.259186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znb7t"]
Jul 11 01:15:14.261341 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:15:14.261314    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb99a4c76_6fe6_4411_93fe_4b85bd744e98.slice/crio-01eabb1cc59873633420a32112876a6f8b4ff6677a7b7d0bf20d0f7becd839bb WatchSource:0}: Error finding container 01eabb1cc59873633420a32112876a6f8b4ff6677a7b7d0bf20d0f7becd839bb: Status 404 returned error can't find the container with id 01eabb1cc59873633420a32112876a6f8b4ff6677a7b7d0bf20d0f7becd839bb
Jul 11 01:15:15.051308 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:15.051219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t" event={"ID":"b99a4c76-6fe6-4411-93fe-4b85bd744e98","Type":"ContainerStarted","Data":"01eabb1cc59873633420a32112876a6f8b4ff6677a7b7d0bf20d0f7becd839bb"}
Jul 11 01:15:15.450873 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:15.450797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:15.502027 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:15.501991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:17.787252 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:17.787224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:17.842136 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:17.842092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:18.063942 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:18.063859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t" event={"ID":"b99a4c76-6fe6-4411-93fe-4b85bd744e98","Type":"ContainerStarted","Data":"edaafe7070d88211a30559d623541bdfb2ba797bca0d823fd65f78fc3e424a21"}
Jul 11 01:15:18.080517 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:18.080468    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znb7t" podStartSLOduration=2.336227556 podStartE2EDuration="5.080450411s" totalImagesPullingTime="2.744222855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:18.079427087 +0000 UTC m=+556.632663005" watchObservedRunningTime="2026-07-11 01:15:18.080450411 +0000 UTC m=+556.633686319"
Jul 11 01:15:21.138646 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:21.138612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:26.857254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:26.857221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:26.958023 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:26.957984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:33.316651 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:33.316617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:33.418955 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:33.418926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:35.206194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:35.206161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:39.440330 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.440292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:39.481001 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.480969    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"]
Jul 11 01:15:39.485466 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.485445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.487547 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.487522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 11 01:15:39.488333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.488309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 11 01:15:39.488333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.488329    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 11 01:15:39.488494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.488313    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 11 01:15:39.488494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.488343    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:15:39.488494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.488434    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-97678\""
Jul 11 01:15:39.494068 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.494045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"]
Jul 11 01:15:39.636402 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.636368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkjs8\" (UniqueName: \"kubernetes.io/projected/99231ec3-1e02-4a37-bf1f-6c65ada2f258-kube-api-access-pkjs8\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.636579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.636414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99231ec3-1e02-4a37-bf1f-6c65ada2f258-manager-config\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.636579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.636465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99231ec3-1e02-4a37-bf1f-6c65ada2f258-metrics-cert\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.636579 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.636485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99231ec3-1e02-4a37-bf1f-6c65ada2f258-cert\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.737729 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.737614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99231ec3-1e02-4a37-bf1f-6c65ada2f258-manager-config\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.737905 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.737728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99231ec3-1e02-4a37-bf1f-6c65ada2f258-metrics-cert\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.737905 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.737777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99231ec3-1e02-4a37-bf1f-6c65ada2f258-cert\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.737905 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.737858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkjs8\" (UniqueName: \"kubernetes.io/projected/99231ec3-1e02-4a37-bf1f-6c65ada2f258-kube-api-access-pkjs8\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.738422 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.738394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99231ec3-1e02-4a37-bf1f-6c65ada2f258-manager-config\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.740330 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.740287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99231ec3-1e02-4a37-bf1f-6c65ada2f258-cert\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.743699 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.740654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99231ec3-1e02-4a37-bf1f-6c65ada2f258-metrics-cert\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.747223 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.747193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkjs8\" (UniqueName: \"kubernetes.io/projected/99231ec3-1e02-4a37-bf1f-6c65ada2f258-kube-api-access-pkjs8\") pod \"lws-controller-manager-78b66d76bd-8g25k\" (UID: \"99231ec3-1e02-4a37-bf1f-6c65ada2f258\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.795202 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.795165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:39.929359 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:39.929334    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"]
Jul 11 01:15:39.932060 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:15:39.932030    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99231ec3_1e02_4a37_bf1f_6c65ada2f258.slice/crio-6001069f88404120cb894518e18d4026bf13ece41db6e52dc2ad71edcb7c6596 WatchSource:0}: Error finding container 6001069f88404120cb894518e18d4026bf13ece41db6e52dc2ad71edcb7c6596: Status 404 returned error can't find the container with id 6001069f88404120cb894518e18d4026bf13ece41db6e52dc2ad71edcb7c6596
Jul 11 01:15:40.151544 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:40.151511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k" event={"ID":"99231ec3-1e02-4a37-bf1f-6c65ada2f258","Type":"ContainerStarted","Data":"6001069f88404120cb894518e18d4026bf13ece41db6e52dc2ad71edcb7c6596"}
Jul 11 01:15:40.779502 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:40.779470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:43.169950 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:43.169913    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k" event={"ID":"99231ec3-1e02-4a37-bf1f-6c65ada2f258","Type":"ContainerStarted","Data":"9efa144eb0f0409c2c931bf8daee57a63817f241fdcb2b1c24b423a0663acedf"}
Jul 11 01:15:43.170355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:43.170049    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:43.184594 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:43.184540    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k" podStartSLOduration=1.697670382 podStartE2EDuration="4.184525311s" totalImagesPullingTime="2.486854929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:43.183816658 +0000 UTC m=+581.737052558" watchObservedRunningTime="2026-07-11 01:15:43.184525311 +0000 UTC m=+581.737761216"
Jul 11 01:15:48.068461 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:48.068429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:48.165114 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:48.165078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:48.675032 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:48.674998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:48.880858 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:48.880828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:48.982771 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:48.982642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:49.009868 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.009829    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"]
Jul 11 01:15:49.014102 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.014075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.016931 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.016903    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 11 01:15:49.017081 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.016943    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 11 01:15:49.017263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017144    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ppx5t\""
Jul 11 01:15:49.017263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017163    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 11 01:15:49.017400 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017290    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 11 01:15:49.017532 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40168dac-aaa9-4fcb-aebc-a4e636c8d572-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.017570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40168dac-aaa9-4fcb-aebc-a4e636c8d572-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.017570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j8ss\" (UniqueName: \"kubernetes.io/projected/40168dac-aaa9-4fcb-aebc-a4e636c8d572-kube-api-access-6j8ss\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.017659 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40168dac-aaa9-4fcb-aebc-a4e636c8d572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.017753 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.017740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40168dac-aaa9-4fcb-aebc-a4e636c8d572-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.029900 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.029868    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"]
Jul 11 01:15:49.118788 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.118752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40168dac-aaa9-4fcb-aebc-a4e636c8d572-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.119265 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.118790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40168dac-aaa9-4fcb-aebc-a4e636c8d572-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.119265 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.118818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j8ss\" (UniqueName: \"kubernetes.io/projected/40168dac-aaa9-4fcb-aebc-a4e636c8d572-kube-api-access-6j8ss\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.119265 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.118867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40168dac-aaa9-4fcb-aebc-a4e636c8d572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.119265 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.118959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40168dac-aaa9-4fcb-aebc-a4e636c8d572-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.119429 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.119360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40168dac-aaa9-4fcb-aebc-a4e636c8d572-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.121277 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.121252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40168dac-aaa9-4fcb-aebc-a4e636c8d572-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.121395 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.121376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40168dac-aaa9-4fcb-aebc-a4e636c8d572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.121438 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.121420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40168dac-aaa9-4fcb-aebc-a4e636c8d572-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.129677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.129650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j8ss\" (UniqueName: \"kubernetes.io/projected/40168dac-aaa9-4fcb-aebc-a4e636c8d572-kube-api-access-6j8ss\") pod \"opendatahub-operator-controller-manager-68fcd49758-r7f7m\" (UID: \"40168dac-aaa9-4fcb-aebc-a4e636c8d572\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.182519 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.182476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:49.287740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.287609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:49.324885 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.324850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:49.383743 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.383664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:49.449977 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.449944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:49.458235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.458207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"]
Jul 11 01:15:49.461759 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:15:49.461718    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40168dac_aaa9_4fcb_aebc_a4e636c8d572.slice/crio-e8b678e5622a0d14ed6db4707a1473f14d711b542071e4216317de8c3daace76 WatchSource:0}: Error finding container e8b678e5622a0d14ed6db4707a1473f14d711b542071e4216317de8c3daace76: Status 404 returned error can't find the container with id e8b678e5622a0d14ed6db4707a1473f14d711b542071e4216317de8c3daace76
Jul 11 01:15:49.512054 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.512017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:49.610948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.610853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:49.711919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:49.711884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:15:50.202754 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:50.202714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m" event={"ID":"40168dac-aaa9-4fcb-aebc-a4e636c8d572","Type":"ContainerStarted","Data":"e8b678e5622a0d14ed6db4707a1473f14d711b542071e4216317de8c3daace76"}
Jul 11 01:15:53.218753 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:53.218717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m" event={"ID":"40168dac-aaa9-4fcb-aebc-a4e636c8d572","Type":"ContainerStarted","Data":"31436ea8d4f5767736d3bed79c25963c258b1d90894a300be9e5e993ecb7ec0b"}
Jul 11 01:15:54.176322 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:54.176292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-8g25k"
Jul 11 01:15:54.225272 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:54.225234    2563 generic.go:356] "Generic (PLEG): container finished" podID="40168dac-aaa9-4fcb-aebc-a4e636c8d572" containerID="31436ea8d4f5767736d3bed79c25963c258b1d90894a300be9e5e993ecb7ec0b" exitCode=0
Jul 11 01:15:54.225657 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:54.225309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m" event={"ID":"40168dac-aaa9-4fcb-aebc-a4e636c8d572","Type":"ContainerDied","Data":"31436ea8d4f5767736d3bed79c25963c258b1d90894a300be9e5e993ecb7ec0b"}
Jul 11 01:15:55.231819 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:55.231782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m" event={"ID":"40168dac-aaa9-4fcb-aebc-a4e636c8d572","Type":"ContainerStarted","Data":"0ff8e835f6a374bca5277aaeb17ebc86dfd42a4bebec0d9526cbd8f731a4963d"}
Jul 11 01:15:55.232216 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:55.231859    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:15:55.252996 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:15:55.252946    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m" podStartSLOduration=2.795198433 podStartE2EDuration="7.252929544s" totalImagesPullingTime="3.407678308s" totalInitContainerRuntime="1.050052803s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:55.251244414 +0000 UTC m=+593.804480329" watchObservedRunningTime="2026-07-11 01:15:55.252929544 +0000 UTC m=+593.806165450"
Jul 11 01:16:00.206608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:00.206572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:00.306646 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:00.306595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:01.898911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:01.898877    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:16:01.899342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:01.898970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:16:01.904915 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:01.904878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:16:01.905070 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:01.904978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:16:06.238849 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:06.238814    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-r7f7m"
Jul 11 01:16:07.801506 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:07.801456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:07.921399 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:07.921369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:08.275288 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.275253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:08.379202 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.379171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:08.521712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.521657    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"]
Jul 11 01:16:08.527252 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.527183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.529780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.529754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 11 01:16:08.529925 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.529819    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 11 01:16:08.530581 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.530555    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 11 01:16:08.530884 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.530863    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zvm7j\""
Jul 11 01:16:08.531009 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.530991    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 11 01:16:08.537132 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.537106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"]
Jul 11 01:16:08.602529 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.602494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2985\" (UniqueName: \"kubernetes.io/projected/8a537606-f43e-4302-a799-775e01bc0c6e-kube-api-access-j2985\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.602529 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.602532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a537606-f43e-4302-a799-775e01bc0c6e-tmp\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.602789 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.602650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a537606-f43e-4302-a799-775e01bc0c6e-tls-certs\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.673200 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.673168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:08.704036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.704005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a537606-f43e-4302-a799-775e01bc0c6e-tls-certs\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.704194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.704097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2985\" (UniqueName: \"kubernetes.io/projected/8a537606-f43e-4302-a799-775e01bc0c6e-kube-api-access-j2985\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.704194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.704125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a537606-f43e-4302-a799-775e01bc0c6e-tmp\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.706593 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.706562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a537606-f43e-4302-a799-775e01bc0c6e-tmp\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.706737 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.706565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a537606-f43e-4302-a799-775e01bc0c6e-tls-certs\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.718078 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.718052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2985\" (UniqueName: \"kubernetes.io/projected/8a537606-f43e-4302-a799-775e01bc0c6e-kube-api-access-j2985\") pod \"kube-auth-proxy-57dcd4c987-2rcpm\" (UID: \"8a537606-f43e-4302-a799-775e01bc0c6e\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.759747 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.759711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:08.837542 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.837460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"
Jul 11 01:16:08.976543 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.976512    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm"]
Jul 11 01:16:08.979925 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:16:08.979898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a537606_f43e_4302_a799_775e01bc0c6e.slice/crio-44fe22f5d47a2efc20229c34bb8fc3f5fa62d9e681f8d7cbb004b31aba4661cc WatchSource:0}: Error finding container 44fe22f5d47a2efc20229c34bb8fc3f5fa62d9e681f8d7cbb004b31aba4661cc: Status 404 returned error can't find the container with id 44fe22f5d47a2efc20229c34bb8fc3f5fa62d9e681f8d7cbb004b31aba4661cc
Jul 11 01:16:08.982126 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:08.982106    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:16:09.265400 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:09.265354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:09.294639 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:09.294603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm" event={"ID":"8a537606-f43e-4302-a799-775e01bc0c6e","Type":"ContainerStarted","Data":"44fe22f5d47a2efc20229c34bb8fc3f5fa62d9e681f8d7cbb004b31aba4661cc"}
Jul 11 01:16:09.462945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:09.462913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:09.547345 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:09.547231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:09.663170 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:09.663133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:09.727669 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:09.727634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:10.382711 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:10.382653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:11.738971 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:11.738945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:12.309189 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:12.309151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm" event={"ID":"8a537606-f43e-4302-a799-775e01bc0c6e","Type":"ContainerStarted","Data":"67277a260eacb63571a407f2952ee1ea94502e55d2514432954d7aa03f8ff0ba"}
Jul 11 01:16:12.325080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:12.325035    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-2rcpm" podStartSLOduration=1.592837388 podStartE2EDuration="4.325016901s" totalImagesPullingTime="2.732179513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:12.322764793 +0000 UTC m=+610.876000711" watchObservedRunningTime="2026-07-11 01:16:12.325016901 +0000 UTC m=+610.878252809"
Jul 11 01:16:15.612522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:15.612492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:15.718531 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:15.718500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:16.248294 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:16.248259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:16.387016 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:16.386984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:16.663038 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:16.663009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:19.719004 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:19.718973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:19.811072 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:19.811041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:20.045537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:20.045434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:20.140546 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:20.140517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:20.969157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:20.969119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:21.076572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:21.076534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:21.181058 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:21.181005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:54.636209 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:54.636095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:54.734415 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:54.734363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:56.584676 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:56.584637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:16:56.685584 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:16:56.685551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:09.281470 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:09.281436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:09.387040 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:09.387008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:09.455199 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:09.455165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:10.207662 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:10.207631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:10.411343 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:10.411306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:37.512284 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:37.512245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:41.776629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:41.776595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:42.031550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:42.031464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:42.716660 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:42.716629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:43.113814 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:43.113740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:44.553836 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:44.553797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:45.933549 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:45.933493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:47.569444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:47.569407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:48.542187 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:48.542154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:50.346449 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.346419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:50.369767 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.369734    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"]
Jul 11 01:17:50.372974 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.372958    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"
Jul 11 01:17:50.375351 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.375324    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 01:17:50.375467 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.375451    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 11 01:17:50.376137 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.376119    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-89ntn\""
Jul 11 01:17:50.376233 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.376140    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 01:17:50.382706 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.382670    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"]
Jul 11 01:17:50.484776 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.484748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fmd\" (UniqueName: \"kubernetes.io/projected/efd3217d-a98b-4466-81c6-1df0624c2f9e-kube-api-access-72fmd\") pod \"dns-operator-controller-manager-864dd78c4c-fpmkx\" (UID: \"efd3217d-a98b-4466-81c6-1df0624c2f9e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"
Jul 11 01:17:50.585387 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.585356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72fmd\" (UniqueName: \"kubernetes.io/projected/efd3217d-a98b-4466-81c6-1df0624c2f9e-kube-api-access-72fmd\") pod \"dns-operator-controller-manager-864dd78c4c-fpmkx\" (UID: \"efd3217d-a98b-4466-81c6-1df0624c2f9e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"
Jul 11 01:17:50.595905 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.595877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fmd\" (UniqueName: \"kubernetes.io/projected/efd3217d-a98b-4466-81c6-1df0624c2f9e-kube-api-access-72fmd\") pod \"dns-operator-controller-manager-864dd78c4c-fpmkx\" (UID: \"efd3217d-a98b-4466-81c6-1df0624c2f9e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"
Jul 11 01:17:50.683902 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.683864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"
Jul 11 01:17:50.811553 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.811525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"]
Jul 11 01:17:50.813733 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:17:50.813701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd3217d_a98b_4466_81c6_1df0624c2f9e.slice/crio-36a9e1a79f49ba2a4a98b07eafe7d28265b79aec28035e29d8f13b1c7744782e WatchSource:0}: Error finding container 36a9e1a79f49ba2a4a98b07eafe7d28265b79aec28035e29d8f13b1c7744782e: Status 404 returned error can't find the container with id 36a9e1a79f49ba2a4a98b07eafe7d28265b79aec28035e29d8f13b1c7744782e
Jul 11 01:17:50.917000 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:50.916962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:51.768095 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.768062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx" event={"ID":"efd3217d-a98b-4466-81c6-1df0624c2f9e","Type":"ContainerStarted","Data":"36a9e1a79f49ba2a4a98b07eafe7d28265b79aec28035e29d8f13b1c7744782e"}
Jul 11 01:17:51.816759 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.816598    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9db54d48-gdvr8"]
Jul 11 01:17:51.820824 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.820795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.824117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.823912    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 11 01:17:51.824117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.823928    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 11 01:17:51.824117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.823973    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 11 01:17:51.824117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.823912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 11 01:17:51.824447 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.824437    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 11 01:17:51.824663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.824570    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qcgjm\""
Jul 11 01:17:51.829071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.829039    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9db54d48-gdvr8"]
Jul 11 01:17:51.830536 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.830514    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 11 01:17:51.870960 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.870914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:51.896153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.896121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7gs8\" (UniqueName: \"kubernetes.io/projected/bca0a124-da9f-45c8-a37d-2f3947915a09-kube-api-access-b7gs8\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.896304 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.896169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-service-ca\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.896304 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.896192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-oauth-serving-cert\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.896304 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.896210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-console-config\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.896304 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.896237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bca0a124-da9f-45c8-a37d-2f3947915a09-console-serving-cert\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.896304 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.896292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-trusted-ca-bundle\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.896554 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.896436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bca0a124-da9f-45c8-a37d-2f3947915a09-console-oauth-config\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.997494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.997461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bca0a124-da9f-45c8-a37d-2f3947915a09-console-oauth-config\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.997694 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.997523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7gs8\" (UniqueName: \"kubernetes.io/projected/bca0a124-da9f-45c8-a37d-2f3947915a09-kube-api-access-b7gs8\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.997694 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.997560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-service-ca\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.998090 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.998061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-oauth-serving-cert\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.998212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.998109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-console-config\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.998212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.998159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bca0a124-da9f-45c8-a37d-2f3947915a09-console-serving-cert\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.998212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.998197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-trusted-ca-bundle\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.998383 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.998295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-service-ca\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.998810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.998781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-oauth-serving-cert\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.999065 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.999010    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-console-config\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:51.999158 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:51.999079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bca0a124-da9f-45c8-a37d-2f3947915a09-trusted-ca-bundle\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:52.001082 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.001060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bca0a124-da9f-45c8-a37d-2f3947915a09-console-oauth-config\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:52.002078 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.002056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bca0a124-da9f-45c8-a37d-2f3947915a09-console-serving-cert\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:52.004802 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.004781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7gs8\" (UniqueName: \"kubernetes.io/projected/bca0a124-da9f-45c8-a37d-2f3947915a09-kube-api-access-b7gs8\") pod \"console-5d9db54d48-gdvr8\" (UID: \"bca0a124-da9f-45c8-a37d-2f3947915a09\") " pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:52.009358 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.009334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:52.063088 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.063003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:52.134949 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.134922    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:17:52.323801 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.323779    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9db54d48-gdvr8"]
Jul 11 01:17:52.325692 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:17:52.325658    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca0a124_da9f_45c8_a37d_2f3947915a09.slice/crio-07a88b26b05a490ed16e2021129d9ca9cc700ad6be82663e4f468d58fddb5c54 WatchSource:0}: Error finding container 07a88b26b05a490ed16e2021129d9ca9cc700ad6be82663e4f468d58fddb5c54: Status 404 returned error can't find the container with id 07a88b26b05a490ed16e2021129d9ca9cc700ad6be82663e4f468d58fddb5c54
Jul 11 01:17:52.527487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.527454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:52.578179 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.578107    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"]
Jul 11 01:17:52.581443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.581425    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.583757 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.583732    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 11 01:17:52.583906 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.583734    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 11 01:17:52.583906 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.583769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2w9km\""
Jul 11 01:17:52.588043 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.588022    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"]
Jul 11 01:17:52.600204 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.600176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:52.651629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.651601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:52.705494 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.705469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqwfm\" (UniqueName: \"kubernetes.io/projected/910ee2bc-6468-4435-ba54-c24d187114f6-kube-api-access-mqwfm\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.705651 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.705524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/910ee2bc-6468-4435-ba54-c24d187114f6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.705651 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.705624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/910ee2bc-6468-4435-ba54-c24d187114f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.775333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.775302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9db54d48-gdvr8" event={"ID":"bca0a124-da9f-45c8-a37d-2f3947915a09","Type":"ContainerStarted","Data":"59347456407cb671d4d1ef45cc21f2c83836e8cbe3ffa4c6b5449d841ec8a156"}
Jul 11 01:17:52.775791 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.775362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9db54d48-gdvr8" event={"ID":"bca0a124-da9f-45c8-a37d-2f3947915a09","Type":"ContainerStarted","Data":"07a88b26b05a490ed16e2021129d9ca9cc700ad6be82663e4f468d58fddb5c54"}
Jul 11 01:17:52.794316 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.794264    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9db54d48-gdvr8" podStartSLOduration=1.794250396 podStartE2EDuration="1.794250396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:17:52.793231455 +0000 UTC m=+711.346467385" watchObservedRunningTime="2026-07-11 01:17:52.794250396 +0000 UTC m=+711.347486302"
Jul 11 01:17:52.806172 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.806143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqwfm\" (UniqueName: \"kubernetes.io/projected/910ee2bc-6468-4435-ba54-c24d187114f6-kube-api-access-mqwfm\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.806289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.806195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/910ee2bc-6468-4435-ba54-c24d187114f6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.806289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.806225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/910ee2bc-6468-4435-ba54-c24d187114f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.806362 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:17:52.806316    2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 11 01:17:52.806409 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:17:52.806371    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910ee2bc-6468-4435-ba54-c24d187114f6-plugin-serving-cert podName:910ee2bc-6468-4435-ba54-c24d187114f6 nodeName:}" failed. No retries permitted until 2026-07-11 01:17:53.306353604 +0000 UTC m=+711.859589500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/910ee2bc-6468-4435-ba54-c24d187114f6-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-sz4l9" (UID: "910ee2bc-6468-4435-ba54-c24d187114f6") : secret "plugin-serving-cert" not found
Jul 11 01:17:52.806841 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.806823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/910ee2bc-6468-4435-ba54-c24d187114f6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.814062 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.814032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqwfm\" (UniqueName: \"kubernetes.io/projected/910ee2bc-6468-4435-ba54-c24d187114f6-kube-api-access-mqwfm\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:52.817748 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.817726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:52.918586 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:52.918553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:53.279851 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.279830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:17:53.312471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.312439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/910ee2bc-6468-4435-ba54-c24d187114f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:53.314641 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.314617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/910ee2bc-6468-4435-ba54-c24d187114f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sz4l9\" (UID: \"910ee2bc-6468-4435-ba54-c24d187114f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:53.492576 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.492505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"
Jul 11 01:17:53.615764 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.615728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9"]
Jul 11 01:17:53.618446 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:17:53.618419    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod910ee2bc_6468_4435_ba54_c24d187114f6.slice/crio-a2f267b2aa22d2f8109ed38743ffebb86c21527b3491cf08b0494cca6341ae59 WatchSource:0}: Error finding container a2f267b2aa22d2f8109ed38743ffebb86c21527b3491cf08b0494cca6341ae59: Status 404 returned error can't find the container with id a2f267b2aa22d2f8109ed38743ffebb86c21527b3491cf08b0494cca6341ae59
Jul 11 01:17:53.780571 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.780476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9" event={"ID":"910ee2bc-6468-4435-ba54-c24d187114f6","Type":"ContainerStarted","Data":"a2f267b2aa22d2f8109ed38743ffebb86c21527b3491cf08b0494cca6341ae59"}
Jul 11 01:17:53.782080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.782055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx" event={"ID":"efd3217d-a98b-4466-81c6-1df0624c2f9e","Type":"ContainerStarted","Data":"d48409142b0162258e5857352973bb918f5b6152780c026211029e5366977758"}
Jul 11 01:17:53.798350 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:53.798306    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx" podStartSLOduration=1.417103896 podStartE2EDuration="3.798293121s" totalImagesPullingTime="2.381189225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:17:53.796544672 +0000 UTC m=+712.349780600" watchObservedRunningTime="2026-07-11 01:17:53.798293121 +0000 UTC m=+712.351529028"
Jul 11 01:17:54.788795 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:17:54.788761    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"
Jul 11 01:18:02.135184 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:02.135154    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:18:02.135749 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:02.135728    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:18:02.140842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:02.140822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:18:02.786834 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:02.786800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:02.836912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:02.836883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d9db54d48-gdvr8"
Jul 11 01:18:02.905705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:02.905656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:03.008315 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:03.008274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:03.110995 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:03.110910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:03.231226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:03.231189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:05.747289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:05.747243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:05.796555 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:05.796519    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fpmkx"
Jul 11 01:18:05.818879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:05.818799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:08.176786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:08.176749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:08.232862 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:08.232810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:14.129437 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:14.129406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:14.184670 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:14.184597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:14.898880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:14.898846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9" event={"ID":"910ee2bc-6468-4435-ba54-c24d187114f6","Type":"ContainerStarted","Data":"103d1c1caf501994033b1efeee7dcff18f7c1e73b83018d6bd765c16ffb145ef"}
Jul 11 01:18:14.914027 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:14.913974    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sz4l9" podStartSLOduration=2.095078272 podStartE2EDuration="22.913959051s" totalImagesPullingTime="20.818880779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:14.912091217 +0000 UTC m=+733.465327137" watchObservedRunningTime="2026-07-11 01:18:14.913959051 +0000 UTC m=+733.467194956"
Jul 11 01:18:22.948318 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:22.948280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:23.048215 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:23.048176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:25.941229 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:25.941171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:26.041240 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:26.041208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:28.385223 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:28.385186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:28.483703 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:28.483654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:32.940135 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:32.940106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:33.201106 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:33.201031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:34.922977 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:34.922944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:35.026095 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.026064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:35.125797 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.125761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:35.348422 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.348345    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:18:35.361130 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.361103    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:18:35.361297 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.361199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.363563 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.363539    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 11 01:18:35.373112 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.373087    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:18:35.500389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.500360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd6c43eb-9493-406f-a895-f6c8262bba0f-config-file\") pod \"limitador-limitador-54d6d988d5-g4vfm\" (UID: \"dd6c43eb-9493-406f-a895-f6c8262bba0f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.500561 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.500424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26sff\" (UniqueName: \"kubernetes.io/projected/dd6c43eb-9493-406f-a895-f6c8262bba0f-kube-api-access-26sff\") pod \"limitador-limitador-54d6d988d5-g4vfm\" (UID: \"dd6c43eb-9493-406f-a895-f6c8262bba0f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.601524 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.601436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd6c43eb-9493-406f-a895-f6c8262bba0f-config-file\") pod \"limitador-limitador-54d6d988d5-g4vfm\" (UID: \"dd6c43eb-9493-406f-a895-f6c8262bba0f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.601524 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.601506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26sff\" (UniqueName: \"kubernetes.io/projected/dd6c43eb-9493-406f-a895-f6c8262bba0f-kube-api-access-26sff\") pod \"limitador-limitador-54d6d988d5-g4vfm\" (UID: \"dd6c43eb-9493-406f-a895-f6c8262bba0f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.602148 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.602125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd6c43eb-9493-406f-a895-f6c8262bba0f-config-file\") pod \"limitador-limitador-54d6d988d5-g4vfm\" (UID: \"dd6c43eb-9493-406f-a895-f6c8262bba0f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.608937 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.608912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26sff\" (UniqueName: \"kubernetes.io/projected/dd6c43eb-9493-406f-a895-f6c8262bba0f-kube-api-access-26sff\") pod \"limitador-limitador-54d6d988d5-g4vfm\" (UID: \"dd6c43eb-9493-406f-a895-f6c8262bba0f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.674570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.674538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:35.754792 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.754734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:35.807542 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.807407    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:18:35.810198 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:18:35.810170    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6c43eb_9493_406f_a895_f6c8262bba0f.slice/crio-60f06d63b56926efee14e0265de974cf6a9d35c5563304c83dedf033ccb59891 WatchSource:0}: Error finding container 60f06d63b56926efee14e0265de974cf6a9d35c5563304c83dedf033ccb59891: Status 404 returned error can't find the container with id 60f06d63b56926efee14e0265de974cf6a9d35c5563304c83dedf033ccb59891
Jul 11 01:18:35.812740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.812718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:35.910889 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.910859    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kzz2c"]
Jul 11 01:18:35.914020 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.914004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kzz2c"
Jul 11 01:18:35.916553 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.916350    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmtrn\""
Jul 11 01:18:35.918742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:35.918712    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kzz2c"]
Jul 11 01:18:36.001941 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:36.001903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm" event={"ID":"dd6c43eb-9493-406f-a895-f6c8262bba0f","Type":"ContainerStarted","Data":"60f06d63b56926efee14e0265de974cf6a9d35c5563304c83dedf033ccb59891"}
Jul 11 01:18:36.005416 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:36.005388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxblw\" (UniqueName: \"kubernetes.io/projected/524c9007-2349-45d3-b211-cd231186bb86-kube-api-access-wxblw\") pod \"authorino-75d556bd77-kzz2c\" (UID: \"524c9007-2349-45d3-b211-cd231186bb86\") " pod="kuadrant-system/authorino-75d556bd77-kzz2c"
Jul 11 01:18:36.106201 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:36.106170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxblw\" (UniqueName: \"kubernetes.io/projected/524c9007-2349-45d3-b211-cd231186bb86-kube-api-access-wxblw\") pod \"authorino-75d556bd77-kzz2c\" (UID: \"524c9007-2349-45d3-b211-cd231186bb86\") " pod="kuadrant-system/authorino-75d556bd77-kzz2c"
Jul 11 01:18:36.113574 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:36.113546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxblw\" (UniqueName: \"kubernetes.io/projected/524c9007-2349-45d3-b211-cd231186bb86-kube-api-access-wxblw\") pod \"authorino-75d556bd77-kzz2c\" (UID: \"524c9007-2349-45d3-b211-cd231186bb86\") " pod="kuadrant-system/authorino-75d556bd77-kzz2c"
Jul 11 01:18:36.224647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:36.224528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kzz2c"
Jul 11 01:18:36.425227 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:36.425194    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kzz2c"]
Jul 11 01:18:37.010491 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:37.010445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kzz2c" event={"ID":"524c9007-2349-45d3-b211-cd231186bb86","Type":"ContainerStarted","Data":"676d00ef081b1c9cb0a6558873b69a74735acc9468f3ac5a9cee02082a209bd4"}
Jul 11 01:18:41.033453 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:41.033417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm" event={"ID":"dd6c43eb-9493-406f-a895-f6c8262bba0f","Type":"ContainerStarted","Data":"de06c8b6eab8fccf65e1d11efc9f57eb608f94f075e7ace86b4ca813022f3897"}
Jul 11 01:18:41.033913 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:41.033506    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:41.034899 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:41.034878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kzz2c" event={"ID":"524c9007-2349-45d3-b211-cd231186bb86","Type":"ContainerStarted","Data":"a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa"}
Jul 11 01:18:41.049207 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:41.049163    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm" podStartSLOduration=1.78156776 podStartE2EDuration="6.049148772s" totalImagesPullingTime="4.267581012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:41.047073735 +0000 UTC m=+759.600309642" watchObservedRunningTime="2026-07-11 01:18:41.049148772 +0000 UTC m=+759.602384677"
Jul 11 01:18:41.059626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:41.059580    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kzz2c" podStartSLOduration=2.392914963 podStartE2EDuration="6.059567548s" totalImagesPullingTime="3.666652585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:41.058127931 +0000 UTC m=+759.611363836" watchObservedRunningTime="2026-07-11 01:18:41.059567548 +0000 UTC m=+759.612803453"
Jul 11 01:18:47.022295 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:47.022264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:52.040348 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:52.040315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"
Jul 11 01:18:56.112915 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:56.112873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:56.219930 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:56.219895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:18:56.562799 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:18:56.562762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:08.252641 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:08.252608    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:08.608642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:08.608559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:08.962187 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:08.962153    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8648548fcf-6wwn4"]
Jul 11 01:19:08.965378 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:08.965352    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:08.967638 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:08.967614    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 11 01:19:08.972631 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:08.972319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8648548fcf-6wwn4"]
Jul 11 01:19:09.108180 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.108142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9289e953-3567-4d09-bc8d-8500e4d24aa2-tls-cert\") pod \"authorino-8648548fcf-6wwn4\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") " pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:09.108381 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.108256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn26r\" (UniqueName: \"kubernetes.io/projected/9289e953-3567-4d09-bc8d-8500e4d24aa2-kube-api-access-tn26r\") pod \"authorino-8648548fcf-6wwn4\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") " pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:09.209525 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.209483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26r\" (UniqueName: \"kubernetes.io/projected/9289e953-3567-4d09-bc8d-8500e4d24aa2-kube-api-access-tn26r\") pod \"authorino-8648548fcf-6wwn4\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") " pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:09.209777 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.209601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9289e953-3567-4d09-bc8d-8500e4d24aa2-tls-cert\") pod \"authorino-8648548fcf-6wwn4\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") " pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:09.212183 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.212158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9289e953-3567-4d09-bc8d-8500e4d24aa2-tls-cert\") pod \"authorino-8648548fcf-6wwn4\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") " pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:09.216501 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.216437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn26r\" (UniqueName: \"kubernetes.io/projected/9289e953-3567-4d09-bc8d-8500e4d24aa2-kube-api-access-tn26r\") pod \"authorino-8648548fcf-6wwn4\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") " pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:09.275135 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.275095    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:19:09.403148 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:09.403118    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8648548fcf-6wwn4"]
Jul 11 01:19:09.406554 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:19:09.406525    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9289e953_3567_4d09_bc8d_8500e4d24aa2.slice/crio-642c26be2ac44fc28ab77ba8d97534402fd32b7fd182fcef29e5510a11ae1255 WatchSource:0}: Error finding container 642c26be2ac44fc28ab77ba8d97534402fd32b7fd182fcef29e5510a11ae1255: Status 404 returned error can't find the container with id 642c26be2ac44fc28ab77ba8d97534402fd32b7fd182fcef29e5510a11ae1255
Jul 11 01:19:10.171956 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.171919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8648548fcf-6wwn4" event={"ID":"9289e953-3567-4d09-bc8d-8500e4d24aa2","Type":"ContainerStarted","Data":"510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9"}
Jul 11 01:19:10.172158 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.171964    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8648548fcf-6wwn4" event={"ID":"9289e953-3567-4d09-bc8d-8500e4d24aa2","Type":"ContainerStarted","Data":"642c26be2ac44fc28ab77ba8d97534402fd32b7fd182fcef29e5510a11ae1255"}
Jul 11 01:19:10.185970 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.185926    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8648548fcf-6wwn4" podStartSLOduration=1.822699682 podStartE2EDuration="2.185912251s" totalImagesPullingTime="363.212569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:10.185274534 +0000 UTC m=+788.738510450" watchObservedRunningTime="2026-07-11 01:19:10.185912251 +0000 UTC m=+788.739148223"
Jul 11 01:19:10.211279 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.211251    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kzz2c"]
Jul 11 01:19:10.211488 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.211465    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kzz2c" podUID="524c9007-2349-45d3-b211-cd231186bb86" containerName="authorino" containerID="cri-o://a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa" gracePeriod=30
Jul 11 01:19:10.464516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.464488    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kzz2c"
Jul 11 01:19:10.519211 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.519180    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxblw\" (UniqueName: \"kubernetes.io/projected/524c9007-2349-45d3-b211-cd231186bb86-kube-api-access-wxblw\") pod \"524c9007-2349-45d3-b211-cd231186bb86\" (UID: \"524c9007-2349-45d3-b211-cd231186bb86\") "
Jul 11 01:19:10.521280 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.521252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524c9007-2349-45d3-b211-cd231186bb86-kube-api-access-wxblw" (OuterVolumeSpecName: "kube-api-access-wxblw") pod "524c9007-2349-45d3-b211-cd231186bb86" (UID: "524c9007-2349-45d3-b211-cd231186bb86"). InnerVolumeSpecName "kube-api-access-wxblw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:19:10.620044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:10.620007    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxblw\" (UniqueName: \"kubernetes.io/projected/524c9007-2349-45d3-b211-cd231186bb86-kube-api-access-wxblw\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:19:11.178632 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.178595    2563 generic.go:356] "Generic (PLEG): container finished" podID="524c9007-2349-45d3-b211-cd231186bb86" containerID="a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa" exitCode=0
Jul 11 01:19:11.178848 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.178638    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kzz2c"
Jul 11 01:19:11.178848 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.178708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kzz2c" event={"ID":"524c9007-2349-45d3-b211-cd231186bb86","Type":"ContainerDied","Data":"a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa"}
Jul 11 01:19:11.178848 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.178753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kzz2c" event={"ID":"524c9007-2349-45d3-b211-cd231186bb86","Type":"ContainerDied","Data":"676d00ef081b1c9cb0a6558873b69a74735acc9468f3ac5a9cee02082a209bd4"}
Jul 11 01:19:11.178848 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.178776    2563 scope.go:117] "RemoveContainer" containerID="a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa"
Jul 11 01:19:11.187618 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.187602    2563 scope.go:117] "RemoveContainer" containerID="a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa"
Jul 11 01:19:11.187908 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:19:11.187891    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa\": container with ID starting with a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa not found: ID does not exist" containerID="a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa"
Jul 11 01:19:11.187974 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.187918    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa"} err="failed to get container status \"a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa\": rpc error: code = NotFound desc = could not find container \"a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa\": container with ID starting with a47413f23145875d6280276ea25873f5bf664c60b633363b53dd9478517d01fa not found: ID does not exist"
Jul 11 01:19:11.199070 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.199049    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kzz2c"]
Jul 11 01:19:11.201446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:11.201426    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kzz2c"]
Jul 11 01:19:12.055607 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:12.055576    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="524c9007-2349-45d3-b211-cd231186bb86" path="/var/lib/kubelet/pods/524c9007-2349-45d3-b211-cd231186bb86/volumes"
Jul 11 01:19:14.704367 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:14.704332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:14.804898 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:14.804868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:14.855956 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:14.855929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:15.214605 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:15.214567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:18.448360 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:18.448316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:18.544761 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:18.544722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:34.650879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:34.650789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:34.696138 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:34.696107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:50.696366 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:50.696319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:50.804282 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:50.804247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:51.108007 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:51.107925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:51.342959 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:51.342920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:51.563927 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:51.563894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:51.664428 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:51.664391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:19:51.746453 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:19:51.746416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:20:01.654696 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:01.654655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:20:01.751077 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:01.751040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:20:15.852079 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:15.852047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:20:16.310996 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:16.310953    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:20:28.821801 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:28.821755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:20:29.901422 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:29.901390    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:20:48.902172 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.902137    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"]
Jul 11 01:20:48.902524 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.902494    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524c9007-2349-45d3-b211-cd231186bb86" containerName="authorino"
Jul 11 01:20:48.902524 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.902505    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="524c9007-2349-45d3-b211-cd231186bb86" containerName="authorino"
Jul 11 01:20:48.902601 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.902585    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="524c9007-2349-45d3-b211-cd231186bb86" containerName="authorino"
Jul 11 01:20:48.905919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.905895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:48.908168 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.908143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 11 01:20:48.909170 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.909148    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zgpm8\""
Jul 11 01:20:48.909311 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.909239    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 11 01:20:48.909311 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.909243    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 11 01:20:48.915466 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.915446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"]
Jul 11 01:20:48.929010 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:48.928979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:20:49.010308 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.010277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.010436 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.010312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqw2m\" (UniqueName: \"kubernetes.io/projected/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-kube-api-access-vqw2m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.010436 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.010360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.010436 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.010407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.010540 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.010459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.010540 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.010495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.111543 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.111492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.111723 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.111551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.111723 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.111609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.111723 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.111629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqw2m\" (UniqueName: \"kubernetes.io/projected/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-kube-api-access-vqw2m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.111723 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.111718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.111904 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.111761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.111986 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.111964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.112031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.112000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.112132 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.112116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.113880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.113863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.114307 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.114286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.118941 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.118919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqw2m\" (UniqueName: \"kubernetes.io/projected/09ae8d8b-519c-4437-8d6b-04c0a6a2557d-kube-api-access-vqw2m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-42hcv\" (UID: \"09ae8d8b-519c-4437-8d6b-04c0a6a2557d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.237250 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.237164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:49.371487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.371455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"]
Jul 11 01:20:49.375161 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:20:49.375130    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ae8d8b_519c_4437_8d6b_04c0a6a2557d.slice/crio-a3f80f48323c33827760ded35967639a00d38c9902e299b8d9c15141181a978d WatchSource:0}: Error finding container a3f80f48323c33827760ded35967639a00d38c9902e299b8d9c15141181a978d: Status 404 returned error can't find the container with id a3f80f48323c33827760ded35967639a00d38c9902e299b8d9c15141181a978d
Jul 11 01:20:49.647524 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:49.647459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv" event={"ID":"09ae8d8b-519c-4437-8d6b-04c0a6a2557d","Type":"ContainerStarted","Data":"a3f80f48323c33827760ded35967639a00d38c9902e299b8d9c15141181a978d"}
Jul 11 01:20:50.100996 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:50.100901    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:20:50.655662 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:50.655622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv" event={"ID":"09ae8d8b-519c-4437-8d6b-04c0a6a2557d","Type":"ContainerStarted","Data":"b7d39de8a93bcca90cb5a8c16bf801a0f069a08fe77fc6c97f7e5dc8679139fa"}
Jul 11 01:20:50.671420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:50.671371    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv" podStartSLOduration=1.689113546 podStartE2EDuration="2.671352039s" totalImagesPullingTime="982.238493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:20:50.670922387 +0000 UTC m=+889.224158317" watchObservedRunningTime="2026-07-11 01:20:50.671352039 +0000 UTC m=+889.224587923"
Jul 11 01:20:56.207905 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:56.207824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:20:58.010795 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:58.010751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:20:59.237575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:59.237537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:59.238029 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:59.237606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:59.250374 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:59.250348    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:20:59.710145 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:20:59.710113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-42hcv"
Jul 11 01:21:01.931329 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:01.931304    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:21:01.931882 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:01.931305    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:21:01.937504 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:01.937484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:21:01.937721 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:01.937707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:21:06.332344 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:06.332239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:21:08.506332 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:08.506296    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:21:11.998007 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:11.997972    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"]
Jul 11 01:21:12.002923 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.002901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.004998 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.004976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 11 01:21:12.009309 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.009284    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"]
Jul 11 01:21:12.039142 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.039109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:21:12.122726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.122671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qg8w\" (UniqueName: \"kubernetes.io/projected/e68a95d9-f95d-42ce-b9f1-b166554a49b7-kube-api-access-4qg8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.122726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.122733    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.122945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.122751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.122945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.122804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.122945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.122837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.122945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.122853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68a95d9-f95d-42ce-b9f1-b166554a49b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224023 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.223991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qg8w\" (UniqueName: \"kubernetes.io/projected/e68a95d9-f95d-42ce-b9f1-b166554a49b7-kube-api-access-4qg8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68a95d9-f95d-42ce-b9f1-b166554a49b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224518 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.224560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.224544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.226466 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.226446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68a95d9-f95d-42ce-b9f1-b166554a49b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.226712 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.226697    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68a95d9-f95d-42ce-b9f1-b166554a49b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.232275 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.232249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qg8w\" (UniqueName: \"kubernetes.io/projected/e68a95d9-f95d-42ce-b9f1-b166554a49b7-kube-api-access-4qg8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp\" (UID: \"e68a95d9-f95d-42ce-b9f1-b166554a49b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.314468 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.314368    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:12.448468 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.448434    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"]
Jul 11 01:21:12.451871 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:21:12.451838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode68a95d9_f95d_42ce_b9f1_b166554a49b7.slice/crio-3e88f718a950a3ac33deeb03584f789fe129011aacdcb45c1bb421e442cfd30b WatchSource:0}: Error finding container 3e88f718a950a3ac33deeb03584f789fe129011aacdcb45c1bb421e442cfd30b: Status 404 returned error can't find the container with id 3e88f718a950a3ac33deeb03584f789fe129011aacdcb45c1bb421e442cfd30b
Jul 11 01:21:12.453353 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.453334    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:21:12.764566 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.764532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp" event={"ID":"e68a95d9-f95d-42ce-b9f1-b166554a49b7","Type":"ContainerStarted","Data":"bf8a430599e3f7c862a9778fe2e4f4790afb4b5c4d19db5e673a0be04f8de4d9"}
Jul 11 01:21:12.764779 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.764578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp" event={"ID":"e68a95d9-f95d-42ce-b9f1-b166554a49b7","Type":"ContainerStarted","Data":"3e88f718a950a3ac33deeb03584f789fe129011aacdcb45c1bb421e442cfd30b"}
Jul 11 01:21:12.780437 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:12.780385    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp" podStartSLOduration=1.605229617 podStartE2EDuration="1.780368501s" totalImagesPullingTime="175.138884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:21:12.779830005 +0000 UTC m=+911.333065912" watchObservedRunningTime="2026-07-11 01:21:12.780368501 +0000 UTC m=+911.333604407"
Jul 11 01:21:18.439748 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:18.439710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:21:18.539995 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:18.539955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:21:20.998446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:20.998411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:21:22.315381 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:22.315349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:22.315785 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:22.315404    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:22.327455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:22.327429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:21:22.826374 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:21:22.826344    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp"
Jul 11 01:22:18.215064 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:18.215030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:22:18.310978 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:18.310946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:22:19.119580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.119545    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8648548fcf-6wwn4"]
Jul 11 01:22:19.119784 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.119746    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8648548fcf-6wwn4" podUID="9289e953-3567-4d09-bc8d-8500e4d24aa2" containerName="authorino" containerID="cri-o://510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9" gracePeriod=30
Jul 11 01:22:19.329819 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.329751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:22:19.368929 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.368906    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:22:19.429883 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.429854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:22:19.459444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.459419    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9289e953-3567-4d09-bc8d-8500e4d24aa2-tls-cert\") pod \"9289e953-3567-4d09-bc8d-8500e4d24aa2\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") "
Jul 11 01:22:19.459594 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.459459    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn26r\" (UniqueName: \"kubernetes.io/projected/9289e953-3567-4d09-bc8d-8500e4d24aa2-kube-api-access-tn26r\") pod \"9289e953-3567-4d09-bc8d-8500e4d24aa2\" (UID: \"9289e953-3567-4d09-bc8d-8500e4d24aa2\") "
Jul 11 01:22:19.461416 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.461386    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9289e953-3567-4d09-bc8d-8500e4d24aa2-kube-api-access-tn26r" (OuterVolumeSpecName: "kube-api-access-tn26r") pod "9289e953-3567-4d09-bc8d-8500e4d24aa2" (UID: "9289e953-3567-4d09-bc8d-8500e4d24aa2"). InnerVolumeSpecName "kube-api-access-tn26r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:22:19.469456 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.469425    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9289e953-3567-4d09-bc8d-8500e4d24aa2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9289e953-3567-4d09-bc8d-8500e4d24aa2" (UID: "9289e953-3567-4d09-bc8d-8500e4d24aa2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:22:19.560962 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.560926    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9289e953-3567-4d09-bc8d-8500e4d24aa2-tls-cert\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:22:19.560962 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:19.560959    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn26r\" (UniqueName: \"kubernetes.io/projected/9289e953-3567-4d09-bc8d-8500e4d24aa2-kube-api-access-tn26r\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:22:20.084062 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.084035    2563 generic.go:356] "Generic (PLEG): container finished" podID="9289e953-3567-4d09-bc8d-8500e4d24aa2" containerID="510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9" exitCode=0
Jul 11 01:22:20.084197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.084074    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8648548fcf-6wwn4"
Jul 11 01:22:20.084197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.084119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8648548fcf-6wwn4" event={"ID":"9289e953-3567-4d09-bc8d-8500e4d24aa2","Type":"ContainerDied","Data":"510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9"}
Jul 11 01:22:20.084197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.084158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8648548fcf-6wwn4" event={"ID":"9289e953-3567-4d09-bc8d-8500e4d24aa2","Type":"ContainerDied","Data":"642c26be2ac44fc28ab77ba8d97534402fd32b7fd182fcef29e5510a11ae1255"}
Jul 11 01:22:20.084197 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.084176    2563 scope.go:117] "RemoveContainer" containerID="510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9"
Jul 11 01:22:20.092671 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.092655    2563 scope.go:117] "RemoveContainer" containerID="510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9"
Jul 11 01:22:20.092952 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:22:20.092930    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9\": container with ID starting with 510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9 not found: ID does not exist" containerID="510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9"
Jul 11 01:22:20.092990 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.092964    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9"} err="failed to get container status \"510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9\": rpc error: code = NotFound desc = could not find container \"510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9\": container with ID starting with 510d5ce029e93f272fde9048861f2f5316e16d63f7f940708b20d6a5975c69d9 not found: ID does not exist"
Jul 11 01:22:20.099213 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.099193    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8648548fcf-6wwn4"]
Jul 11 01:22:20.104460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:20.104440    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8648548fcf-6wwn4"]
Jul 11 01:22:22.055842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:22.055810    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9289e953-3567-4d09-bc8d-8500e4d24aa2" path="/var/lib/kubelet/pods/9289e953-3567-4d09-bc8d-8500e4d24aa2/volumes"
Jul 11 01:22:45.394351 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:45.394271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:22:45.444443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:45.444404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:22:48.212666 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:48.212632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:22:58.202527 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:22:58.202486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:23:08.406807 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:23:08.406771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:23:17.407831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:23:17.407792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:23:27.609791 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:23:27.609755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:23:27.729515 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:23:27.729483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:23:27.777886 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:23:27.777860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:23:29.407941 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:23:29.407910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:23:31.128192 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:23:31.128156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:06.735997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:06.735923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:06.835289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:06.835258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:06.955166 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:06.955132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:12.652219 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:12.652185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:12.755014 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:12.754976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:12.853317 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:12.853280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:12.980676 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:12.980596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:18.665826 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:18.665789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:18.766123 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:18.766093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:33.990854 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:33.990825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:34.040713 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:34.040638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:24:36.903519 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:36.903485    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:24:49.102239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:24:49.102206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:25:00.831067 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:25:00.831029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:25:00.909359 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:25:00.909324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:25:12.098144 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:25:12.098107    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:25:23.203638 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:25:23.203602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:25:34.108807 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:25:34.108737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:25:46.710239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:25:46.710203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:25:55.307931 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:25:55.307897    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:26:01.962237 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:26:01.962204    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:26:01.962868 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:26:01.962852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:26:01.968732 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:26:01.968651    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:26:01.969149 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:26:01.969129    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:26:20.808389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:26:20.808352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:26:32.696156 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:26:32.696125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:26:54.611980 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:26:54.611894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:27:11.304041 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:27:11.304012    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:27:23.404780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:27:23.404747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:27:33.804488 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:27:33.804448    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:27:43.804083 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:27:43.804050    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:27:50.115026 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:27:50.114978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:27:56.405342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:27:56.405307    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:29:52.028973 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:29:52.028939    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:30:00.139928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.139837    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck"]
Jul 11 01:30:00.140401 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.140382    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9289e953-3567-4d09-bc8d-8500e4d24aa2" containerName="authorino"
Jul 11 01:30:00.140490 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.140405    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9289e953-3567-4d09-bc8d-8500e4d24aa2" containerName="authorino"
Jul 11 01:30:00.140541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.140506    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9289e953-3567-4d09-bc8d-8500e4d24aa2" containerName="authorino"
Jul 11 01:30:00.143621 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.143601    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck"
Jul 11 01:30:00.145975 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.145956    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:30:00.150310 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.150285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck"]
Jul 11 01:30:00.154616 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.154594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck"
Jul 11 01:30:00.289979 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.289946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck"]
Jul 11 01:30:00.292039 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:30:00.292016    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66e2f43_4aae_46c1_85dc_1e30f1ce153d.slice/crio-aa01f7bf4bece68deb48c4156b497a256a4c2b98350d1899bbd9a81a8ac41101 WatchSource:0}: Error finding container aa01f7bf4bece68deb48c4156b497a256a4c2b98350d1899bbd9a81a8ac41101: Status 404 returned error can't find the container with id aa01f7bf4bece68deb48c4156b497a256a4c2b98350d1899bbd9a81a8ac41101
Jul 11 01:30:00.293879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:00.293863    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:30:01.278500 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:01.278466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck" event={"ID":"e66e2f43-4aae-46c1-85dc-1e30f1ce153d","Type":"ContainerStarted","Data":"aa01f7bf4bece68deb48c4156b497a256a4c2b98350d1899bbd9a81a8ac41101"}
Jul 11 01:30:04.107631 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:04.107597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:30:06.307430 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:06.307391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck" event={"ID":"e66e2f43-4aae-46c1-85dc-1e30f1ce153d","Type":"ContainerStarted","Data":"9e6dc05c95d9d33e087930be7ee33ed5be0330c5fae99e54663cce4a26b25bf6"}
Jul 11 01:30:06.321086 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:06.321020    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck" podStartSLOduration=1.162052059 podStartE2EDuration="6.321000744s" totalImagesPullingTime="5.158948685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:30:06.319902718 +0000 UTC m=+1444.873138624" watchObservedRunningTime="2026-07-11 01:30:06.321000744 +0000 UTC m=+1444.874236650"
Jul 11 01:30:07.315575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:07.315536    2563 generic.go:356] "Generic (PLEG): container finished" podID="e66e2f43-4aae-46c1-85dc-1e30f1ce153d" containerID="9e6dc05c95d9d33e087930be7ee33ed5be0330c5fae99e54663cce4a26b25bf6" exitCode=0
Jul 11 01:30:07.315975 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:07.315595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck" event={"ID":"e66e2f43-4aae-46c1-85dc-1e30f1ce153d","Type":"ContainerDied","Data":"9e6dc05c95d9d33e087930be7ee33ed5be0330c5fae99e54663cce4a26b25bf6"}
Jul 11 01:30:08.448198 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:08.448170    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck"
Jul 11 01:30:09.326082 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:09.326058    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck"
Jul 11 01:30:09.326262 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:09.326125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728890-6q9ck" event={"ID":"e66e2f43-4aae-46c1-85dc-1e30f1ce153d","Type":"ContainerDied","Data":"aa01f7bf4bece68deb48c4156b497a256a4c2b98350d1899bbd9a81a8ac41101"}
Jul 11 01:30:09.326262 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:09.326172    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa01f7bf4bece68deb48c4156b497a256a4c2b98350d1899bbd9a81a8ac41101"
Jul 11 01:30:11.277257 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:11.277219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:30:11.328042 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:11.328014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:30:13.711634 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:13.711600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:30:25.707809 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:25.707770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:30:28.720772 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:28.720736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:30:35.805952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:35.805919    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:30:47.303540 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:47.303499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:30:55.504501 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:30:55.504458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:31:01.995172 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:01.995145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:31:01.995832 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:01.995815    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:31:02.002176 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:02.002148    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:31:02.005098 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:02.005070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:31:07.804124 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:07.804083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:31:18.009277 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:18.009240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:31:26.108751 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:26.108635    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:31:40.614690 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:40.614658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:31:55.401745 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:55.401713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:31:55.501535 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:55.501502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:31:58.805135 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:31:58.805100    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:32:08.705699 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:32:08.705641    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:32:19.304592 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:32:19.304554    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:32:29.609880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:32:29.609846    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:32:40.004052 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:32:40.004017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:32:55.304190 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:32:55.304106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:33:05.901303 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:33:05.901268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:33:15.613555 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:33:15.613515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:33:24.808151 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:33:24.808110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:33:38.002629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:33:38.002589    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:33:48.706222 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:33:48.706186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:33:58.605291 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:33:58.605254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:34:13.699822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:34:13.699788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:34:23.509161 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:34:23.509125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:34:37.302447 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:34:37.302362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:34:49.403862 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:34:49.403828    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:35:07.403763 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:07.403731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:35:20.410226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:20.410190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:35:31.508826 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:31.508793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:35:32.325242 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:32.325210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:35:40.057830 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:40.057793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:35:40.603125 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:40.603092    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:35:48.316677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:48.316643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:35:53.395387 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:53.395325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:35:56.276815 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:56.276726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:35:56.366134 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:56.366095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:35:56.700200 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:56.700163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:35:57.832828 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:35:57.832793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:36:02.034177 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.034149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:36:02.035951 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.035929    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:36:02.040153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.040131    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:36:02.042120 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.042101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:36:02.396939 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.396905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:02.454603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.454562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:02.602020 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.601992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:02.710603 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:02.710534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:03.802000 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.801961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:03.898648 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.898605    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"]
Jul 11 01:36:03.899275 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.899243    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e66e2f43-4aae-46c1-85dc-1e30f1ce153d" containerName="cleanup"
Jul 11 01:36:03.899275 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.899270    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e66e2f43-4aae-46c1-85dc-1e30f1ce153d" containerName="cleanup"
Jul 11 01:36:03.899428 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.899355    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e66e2f43-4aae-46c1-85dc-1e30f1ce153d" containerName="cleanup"
Jul 11 01:36:03.900038 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.900015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:03.902895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.902874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:03.905147 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.905126    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:36:03.905254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.905147    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:36:03.905772 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.905756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d0a13ce5-serving-cert\""
Jul 11 01:36:03.905869 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.905793    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:36:03.910004 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.909981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"]
Jul 11 01:36:03.950397 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.950367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b24ee00f-136b-4ab1-8847-a2ea25590007-maas-api-tls\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:03.950566 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.950418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v7bl\" (UniqueName: \"kubernetes.io/projected/b24ee00f-136b-4ab1-8847-a2ea25590007-kube-api-access-2v7bl\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:03.950566 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.950442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b24ee00f-136b-4ab1-8847-a2ea25590007-openshift-service-ca\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:03.958934 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:03.958902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:04.051569 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.051538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b24ee00f-136b-4ab1-8847-a2ea25590007-maas-api-tls\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:04.051746 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.051587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v7bl\" (UniqueName: \"kubernetes.io/projected/b24ee00f-136b-4ab1-8847-a2ea25590007-kube-api-access-2v7bl\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:04.051746 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.051611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b24ee00f-136b-4ab1-8847-a2ea25590007-openshift-service-ca\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:04.052422 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.052369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b24ee00f-136b-4ab1-8847-a2ea25590007-openshift-service-ca\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:04.054378 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.054357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b24ee00f-136b-4ab1-8847-a2ea25590007-maas-api-tls\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:04.061227 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.061190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:04.061334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.061317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v7bl\" (UniqueName: \"kubernetes.io/projected/b24ee00f-136b-4ab1-8847-a2ea25590007-kube-api-access-2v7bl\") pod \"maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:04.215416 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.215379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:04.350826 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.350802    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"]
Jul 11 01:36:04.353417 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:36:04.353389    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24ee00f_136b_4ab1_8847_a2ea25590007.slice/crio-a544447a4c00c6de9cfb8d3fcff21c0364ee6868297b2f5898a7974983fbbd14 WatchSource:0}: Error finding container a544447a4c00c6de9cfb8d3fcff21c0364ee6868297b2f5898a7974983fbbd14: Status 404 returned error can't find the container with id a544447a4c00c6de9cfb8d3fcff21c0364ee6868297b2f5898a7974983fbbd14
Jul 11 01:36:04.354725 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.354706    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:36:04.619428 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.619352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:04.720954 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:04.720920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:05.070554 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:05.070513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6" event={"ID":"b24ee00f-136b-4ab1-8847-a2ea25590007","Type":"ContainerStarted","Data":"a544447a4c00c6de9cfb8d3fcff21c0364ee6868297b2f5898a7974983fbbd14"}
Jul 11 01:36:06.162334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:06.162297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:36:07.080957 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:07.080914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6" event={"ID":"b24ee00f-136b-4ab1-8847-a2ea25590007","Type":"ContainerStarted","Data":"d80833fd5df05e3ba10c93485697b99c071cc7429f91b26437a0f71e655b5a27"}
Jul 11 01:36:07.081140 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:07.081055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:07.097229 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:07.097185    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6" podStartSLOduration=2.405716667 podStartE2EDuration="4.097170455s" totalImagesPullingTime="1.691453788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:36:07.095315935 +0000 UTC m=+1805.648551838" watchObservedRunningTime="2026-07-11 01:36:07.097170455 +0000 UTC m=+1805.650406339"
Jul 11 01:36:08.797997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:08.797968    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"]
Jul 11 01:36:08.801486 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:08.801469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"
Jul 11 01:36:08.803533 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:08.803510    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:36:08.807629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:08.807603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"]
Jul 11 01:36:08.895753 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:08.895721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59761d92-d971-4164-9415-6a2801bc88af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z\" (UID: \"59761d92-d971-4164-9415-6a2801bc88af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"
Jul 11 01:36:08.996854 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:08.996828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59761d92-d971-4164-9415-6a2801bc88af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z\" (UID: \"59761d92-d971-4164-9415-6a2801bc88af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"
Jul 11 01:36:08.997476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:08.997456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59761d92-d971-4164-9415-6a2801bc88af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z\" (UID: \"59761d92-d971-4164-9415-6a2801bc88af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"
Jul 11 01:36:09.112975 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:09.112901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"
Jul 11 01:36:09.238814 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:09.238784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"]
Jul 11 01:36:09.240474 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:36:09.240436    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59761d92_d971_4164_9415_6a2801bc88af.slice/crio-db95c1eb2e8427abe1e2c769dccf056906ed2c5b4bc7d47dcc5342ca23079576 WatchSource:0}: Error finding container db95c1eb2e8427abe1e2c769dccf056906ed2c5b4bc7d47dcc5342ca23079576: Status 404 returned error can't find the container with id db95c1eb2e8427abe1e2c769dccf056906ed2c5b4bc7d47dcc5342ca23079576
Jul 11 01:36:09.709481 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:09.709400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:36:10.096739 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:10.096659    2563 generic.go:356] "Generic (PLEG): container finished" podID="59761d92-d971-4164-9415-6a2801bc88af" containerID="f236e4f80e1b6dce5caa5256058f88aea8b3e71b9707b0e04c84e19756bb8ceb" exitCode=7
Jul 11 01:36:10.097129 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:10.096746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z" event={"ID":"59761d92-d971-4164-9415-6a2801bc88af","Type":"ContainerDied","Data":"f236e4f80e1b6dce5caa5256058f88aea8b3e71b9707b0e04c84e19756bb8ceb"}
Jul 11 01:36:10.097129 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:10.096795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z" event={"ID":"59761d92-d971-4164-9415-6a2801bc88af","Type":"ContainerStarted","Data":"db95c1eb2e8427abe1e2c769dccf056906ed2c5b4bc7d47dcc5342ca23079576"}
Jul 11 01:36:10.097129 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:10.096897    2563 scope.go:117] "RemoveContainer" containerID="f236e4f80e1b6dce5caa5256058f88aea8b3e71b9707b0e04c84e19756bb8ceb"
Jul 11 01:36:11.103158 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:11.103077    2563 generic.go:356] "Generic (PLEG): container finished" podID="59761d92-d971-4164-9415-6a2801bc88af" containerID="69e810a370229377487d6635f15ed9b3afbaa8b33f951bb420499cb1170cac43" exitCode=7
Jul 11 01:36:11.103537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:11.103156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z" event={"ID":"59761d92-d971-4164-9415-6a2801bc88af","Type":"ContainerDied","Data":"69e810a370229377487d6635f15ed9b3afbaa8b33f951bb420499cb1170cac43"}
Jul 11 01:36:11.103537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:11.103212    2563 scope.go:117] "RemoveContainer" containerID="f236e4f80e1b6dce5caa5256058f88aea8b3e71b9707b0e04c84e19756bb8ceb"
Jul 11 01:36:11.103537 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:11.103400    2563 scope.go:117] "RemoveContainer" containerID="69e810a370229377487d6635f15ed9b3afbaa8b33f951bb420499cb1170cac43"
Jul 11 01:36:11.103638 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:36:11.103595    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z_odh-ai-gateway-infra(59761d92-d971-4164-9415-6a2801bc88af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z" podUID="59761d92-d971-4164-9415-6a2801bc88af"
Jul 11 01:36:12.109469 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:12.109445    2563 scope.go:117] "RemoveContainer" containerID="69e810a370229377487d6635f15ed9b3afbaa8b33f951bb420499cb1170cac43"
Jul 11 01:36:12.109870 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:36:12.109625    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z_odh-ai-gateway-infra(59761d92-d971-4164-9415-6a2801bc88af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z" podUID="59761d92-d971-4164-9415-6a2801bc88af"
Jul 11 01:36:13.090587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:13.090557    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:36:26.049733 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:26.049704    2563 scope.go:117] "RemoveContainer" containerID="69e810a370229377487d6635f15ed9b3afbaa8b33f951bb420499cb1170cac43"
Jul 11 01:36:27.183249 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:27.183214    2563 generic.go:356] "Generic (PLEG): container finished" podID="59761d92-d971-4164-9415-6a2801bc88af" containerID="1385f0d81c759c4305b6993b86fcea0619461c6ced1bfb89bdf570d9c6aa1601" exitCode=0
Jul 11 01:36:27.183703 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:27.183285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z" event={"ID":"59761d92-d971-4164-9415-6a2801bc88af","Type":"ContainerDied","Data":"1385f0d81c759c4305b6993b86fcea0619461c6ced1bfb89bdf570d9c6aa1601"}
Jul 11 01:36:27.183703 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:27.183345    2563 scope.go:117] "RemoveContainer" containerID="69e810a370229377487d6635f15ed9b3afbaa8b33f951bb420499cb1170cac43"
Jul 11 01:36:28.212298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:28.212270    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"]
Jul 11 01:36:28.324081 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:28.324059    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"
Jul 11 01:36:28.466856 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:28.466786    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59761d92-d971-4164-9415-6a2801bc88af-maas-api-service-ca\") pod \"59761d92-d971-4164-9415-6a2801bc88af\" (UID: \"59761d92-d971-4164-9415-6a2801bc88af\") "
Jul 11 01:36:28.467097 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:28.467076    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59761d92-d971-4164-9415-6a2801bc88af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59761d92-d971-4164-9415-6a2801bc88af" (UID: "59761d92-d971-4164-9415-6a2801bc88af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:36:28.567665 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:28.567632    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59761d92-d971-4164-9415-6a2801bc88af-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:36:29.195406 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:29.195379    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"
Jul 11 01:36:29.195406 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:29.195386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z" event={"ID":"59761d92-d971-4164-9415-6a2801bc88af","Type":"ContainerDied","Data":"db95c1eb2e8427abe1e2c769dccf056906ed2c5b4bc7d47dcc5342ca23079576"}
Jul 11 01:36:29.195651 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:29.195430    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db95c1eb2e8427abe1e2c769dccf056906ed2c5b4bc7d47dcc5342ca23079576"
Jul 11 01:36:29.222420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:29.222384    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"]
Jul 11 01:36:29.225719 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:29.225677    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-sqx6z"]
Jul 11 01:36:30.055740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:30.055678    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59761d92-d971-4164-9415-6a2801bc88af" path="/var/lib/kubelet/pods/59761d92-d971-4164-9415-6a2801bc88af/volumes"
Jul 11 01:36:49.305884 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:36:49.305852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:08.845773 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.845739    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"]
Jul 11 01:37:08.846350 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.846303    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:08.846350 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.846323    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:08.846473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.846382    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:08.846473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.846394    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:08.846568 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.846493    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:08.846568 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.846507    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:08.849589 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.849563    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"
Jul 11 01:37:08.851667 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.851646    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:37:08.855116 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.855090    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"]
Jul 11 01:37:08.914493 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:08.914466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1748fff-5c33-4d80-bf0d-25aabaefdf75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g\" (UID: \"a1748fff-5c33-4d80-bf0d-25aabaefdf75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"
Jul 11 01:37:09.015675 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:09.015649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1748fff-5c33-4d80-bf0d-25aabaefdf75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g\" (UID: \"a1748fff-5c33-4d80-bf0d-25aabaefdf75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"
Jul 11 01:37:09.016306 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:09.016286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1748fff-5c33-4d80-bf0d-25aabaefdf75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g\" (UID: \"a1748fff-5c33-4d80-bf0d-25aabaefdf75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"
Jul 11 01:37:09.161549 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:09.161524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"
Jul 11 01:37:09.289426 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:09.289400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"]
Jul 11 01:37:09.291388 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:37:09.291366    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1748fff_5c33_4d80_bf0d_25aabaefdf75.slice/crio-9da1e5ad04c0307851aebf9626d8ba230278310bf58e655dcf8c73a62eebb50f WatchSource:0}: Error finding container 9da1e5ad04c0307851aebf9626d8ba230278310bf58e655dcf8c73a62eebb50f: Status 404 returned error can't find the container with id 9da1e5ad04c0307851aebf9626d8ba230278310bf58e655dcf8c73a62eebb50f
Jul 11 01:37:09.389309 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:09.389278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g" event={"ID":"a1748fff-5c33-4d80-bf0d-25aabaefdf75","Type":"ContainerStarted","Data":"9da1e5ad04c0307851aebf9626d8ba230278310bf58e655dcf8c73a62eebb50f"}
Jul 11 01:37:10.395655 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:10.395619    2563 generic.go:356] "Generic (PLEG): container finished" podID="a1748fff-5c33-4d80-bf0d-25aabaefdf75" containerID="c628b93e0a3cd2c07ff95531a92aa56e19a4292a6e9193181c024435098b0ceb" exitCode=0
Jul 11 01:37:10.396035 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:10.395703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g" event={"ID":"a1748fff-5c33-4d80-bf0d-25aabaefdf75","Type":"ContainerDied","Data":"c628b93e0a3cd2c07ff95531a92aa56e19a4292a6e9193181c024435098b0ceb"}
Jul 11 01:37:11.533330 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:11.533306    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"
Jul 11 01:37:11.644777 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:11.644747    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1748fff-5c33-4d80-bf0d-25aabaefdf75-maas-api-service-ca\") pod \"a1748fff-5c33-4d80-bf0d-25aabaefdf75\" (UID: \"a1748fff-5c33-4d80-bf0d-25aabaefdf75\") "
Jul 11 01:37:11.645130 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:11.645103    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1748fff-5c33-4d80-bf0d-25aabaefdf75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1748fff-5c33-4d80-bf0d-25aabaefdf75" (UID: "a1748fff-5c33-4d80-bf0d-25aabaefdf75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:37:11.746233 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:11.746150    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1748fff-5c33-4d80-bf0d-25aabaefdf75-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:37:12.406643 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:12.406602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g" event={"ID":"a1748fff-5c33-4d80-bf0d-25aabaefdf75","Type":"ContainerDied","Data":"9da1e5ad04c0307851aebf9626d8ba230278310bf58e655dcf8c73a62eebb50f"}
Jul 11 01:37:12.406828 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:12.406652    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9da1e5ad04c0307851aebf9626d8ba230278310bf58e655dcf8c73a62eebb50f"
Jul 11 01:37:12.406828 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:12.406615    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g"
Jul 11 01:37:19.219643 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.219610    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"]
Jul 11 01:37:19.220219 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.219998    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6" podUID="b24ee00f-136b-4ab1-8847-a2ea25590007" containerName="maas-api" containerID="cri-o://d80833fd5df05e3ba10c93485697b99c071cc7429f91b26437a0f71e655b5a27" gracePeriod=30
Jul 11 01:37:19.245718 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.245664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:19.447274 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.447235    2563 generic.go:356] "Generic (PLEG): container finished" podID="b24ee00f-136b-4ab1-8847-a2ea25590007" containerID="d80833fd5df05e3ba10c93485697b99c071cc7429f91b26437a0f71e655b5a27" exitCode=0
Jul 11 01:37:19.447421 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.447302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6" event={"ID":"b24ee00f-136b-4ab1-8847-a2ea25590007","Type":"ContainerDied","Data":"d80833fd5df05e3ba10c93485697b99c071cc7429f91b26437a0f71e655b5a27"}
Jul 11 01:37:19.464434 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.464413    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:37:19.519482 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.519405    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b24ee00f-136b-4ab1-8847-a2ea25590007-maas-api-tls\") pod \"b24ee00f-136b-4ab1-8847-a2ea25590007\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") "
Jul 11 01:37:19.519482 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.519445    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b24ee00f-136b-4ab1-8847-a2ea25590007-openshift-service-ca\") pod \"b24ee00f-136b-4ab1-8847-a2ea25590007\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") "
Jul 11 01:37:19.519676 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.519514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v7bl\" (UniqueName: \"kubernetes.io/projected/b24ee00f-136b-4ab1-8847-a2ea25590007-kube-api-access-2v7bl\") pod \"b24ee00f-136b-4ab1-8847-a2ea25590007\" (UID: \"b24ee00f-136b-4ab1-8847-a2ea25590007\") "
Jul 11 01:37:19.519846 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.519823    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b24ee00f-136b-4ab1-8847-a2ea25590007-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b24ee00f-136b-4ab1-8847-a2ea25590007" (UID: "b24ee00f-136b-4ab1-8847-a2ea25590007"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:37:19.521586 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.521565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b24ee00f-136b-4ab1-8847-a2ea25590007-kube-api-access-2v7bl" (OuterVolumeSpecName: "kube-api-access-2v7bl") pod "b24ee00f-136b-4ab1-8847-a2ea25590007" (UID: "b24ee00f-136b-4ab1-8847-a2ea25590007"). InnerVolumeSpecName "kube-api-access-2v7bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:37:19.521670 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.521658    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b24ee00f-136b-4ab1-8847-a2ea25590007-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b24ee00f-136b-4ab1-8847-a2ea25590007" (UID: "b24ee00f-136b-4ab1-8847-a2ea25590007"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:37:19.621080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.621044    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b24ee00f-136b-4ab1-8847-a2ea25590007-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:37:19.621080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.621074    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b24ee00f-136b-4ab1-8847-a2ea25590007-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:37:19.621080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:19.621084    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v7bl\" (UniqueName: \"kubernetes.io/projected/b24ee00f-136b-4ab1-8847-a2ea25590007-kube-api-access-2v7bl\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:37:20.453048 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:20.453016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6" event={"ID":"b24ee00f-136b-4ab1-8847-a2ea25590007","Type":"ContainerDied","Data":"a544447a4c00c6de9cfb8d3fcff21c0364ee6868297b2f5898a7974983fbbd14"}
Jul 11 01:37:20.453048 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:20.453031    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"
Jul 11 01:37:20.453544 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:20.453078    2563 scope.go:117] "RemoveContainer" containerID="d80833fd5df05e3ba10c93485697b99c071cc7429f91b26437a0f71e655b5a27"
Jul 11 01:37:20.467263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:20.467240    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"]
Jul 11 01:37:20.472528 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:20.472507    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a13ce5-547bbc858-lrdk6"]
Jul 11 01:37:22.055906 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:22.055872    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b24ee00f-136b-4ab1-8847-a2ea25590007" path="/var/lib/kubelet/pods/b24ee00f-136b-4ab1-8847-a2ea25590007/volumes"
Jul 11 01:37:22.303077 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:22.303044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:37:23.921305 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:23.921275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:29.492120 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:29.492092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:29.550979 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:29.550948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:34.121039 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:34.121010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:34.502617 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:34.502535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:34.640601 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:34.640565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:34.733250 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:34.733219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:35.748817 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.748788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:35.884008 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.883975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:35.955823 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.955789    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"]
Jul 11 01:37:35.956365 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956346    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b24ee00f-136b-4ab1-8847-a2ea25590007" containerName="maas-api"
Jul 11 01:37:35.956446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956370    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24ee00f-136b-4ab1-8847-a2ea25590007" containerName="maas-api"
Jul 11 01:37:35.956446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956407    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1748fff-5c33-4d80-bf0d-25aabaefdf75" containerName="revoke-keys"
Jul 11 01:37:35.956446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956417    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1748fff-5c33-4d80-bf0d-25aabaefdf75" containerName="revoke-keys"
Jul 11 01:37:35.956446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956430    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:35.956446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956439    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:35.956714 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956542    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b24ee00f-136b-4ab1-8847-a2ea25590007" containerName="maas-api"
Jul 11 01:37:35.956714 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956554    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="59761d92-d971-4164-9415-6a2801bc88af" containerName="revoke-keys"
Jul 11 01:37:35.956714 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.956570    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1748fff-5c33-4d80-bf0d-25aabaefdf75" containerName="revoke-keys"
Jul 11 01:37:35.959992 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.959970    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:35.962194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.962170    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:37:35.962298 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.962218    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:37:35.962981 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.962964    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:37:35.963049 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.962997    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5ecad626-serving-cert\""
Jul 11 01:37:35.968924 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.968907    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"]
Jul 11 01:37:35.994473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:35.994444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:36.067943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.067885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hr5d\" (UniqueName: \"kubernetes.io/projected/1327fecd-1496-46f1-9964-fc9b64563e1b-kube-api-access-2hr5d\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.067943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.067940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.068085 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.068001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1327fecd-1496-46f1-9964-fc9b64563e1b-openshift-service-ca\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.169370 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.169342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1327fecd-1496-46f1-9964-fc9b64563e1b-openshift-service-ca\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.169505 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.169411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hr5d\" (UniqueName: \"kubernetes.io/projected/1327fecd-1496-46f1-9964-fc9b64563e1b-kube-api-access-2hr5d\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.169636 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.169610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.169800 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:37:36.169727    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-serving-cert: secret "maas-api-e2e-migrate-5ecad626-serving-cert" not found
Jul 11 01:37:36.169920 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:37:36.169847    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls podName:1327fecd-1496-46f1-9964-fc9b64563e1b nodeName:}" failed. No retries permitted until 2026-07-11 01:37:36.669832162 +0000 UTC m=+1895.223068049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls") pod "maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j" (UID: "1327fecd-1496-46f1-9964-fc9b64563e1b") : secret "maas-api-e2e-migrate-5ecad626-serving-cert" not found
Jul 11 01:37:36.170061 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.170044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1327fecd-1496-46f1-9964-fc9b64563e1b-openshift-service-ca\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.177524 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.177506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hr5d\" (UniqueName: \"kubernetes.io/projected/1327fecd-1496-46f1-9964-fc9b64563e1b-kube-api-access-2hr5d\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.290461 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.290428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:36.445476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.445444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:36.552421 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.552392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:36.674109 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.674079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.676337 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.676316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls\") pod \"maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:36.872440 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:36.872415    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:37.001046 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:37.001021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"]
Jul 11 01:37:37.002729 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:37:37.002704    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1327fecd_1496_46f1_9964_fc9b64563e1b.slice/crio-3b46b0998413d708180b3942e4403463babb272c2183a8fe22d891835a89bd97 WatchSource:0}: Error finding container 3b46b0998413d708180b3942e4403463babb272c2183a8fe22d891835a89bd97: Status 404 returned error can't find the container with id 3b46b0998413d708180b3942e4403463babb272c2183a8fe22d891835a89bd97
Jul 11 01:37:37.538982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:37.538953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j" event={"ID":"1327fecd-1496-46f1-9964-fc9b64563e1b","Type":"ContainerStarted","Data":"46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2"}
Jul 11 01:37:37.539115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:37.539000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j" event={"ID":"1327fecd-1496-46f1-9964-fc9b64563e1b","Type":"ContainerStarted","Data":"3b46b0998413d708180b3942e4403463babb272c2183a8fe22d891835a89bd97"}
Jul 11 01:37:37.539115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:37.539055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:37.554628 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:37.554582    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j" podStartSLOduration=2.129673227 podStartE2EDuration="2.554569465s" totalImagesPullingTime="424.896238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:37:37.552590096 +0000 UTC m=+1896.105826003" watchObservedRunningTime="2026-07-11 01:37:37.554569465 +0000 UTC m=+1896.107805371"
Jul 11 01:37:38.597766 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:38.597734    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:37:39.266466 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:39.266432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:40.403989 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.403958    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"]
Jul 11 01:37:40.407645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.407627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"
Jul 11 01:37:40.409645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.409626    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:37:40.413288 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.413264    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"]
Jul 11 01:37:40.506417 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.506386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42dd7273-4084-4f7d-860b-65026ad36ab3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7\" (UID: \"42dd7273-4084-4f7d-860b-65026ad36ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"
Jul 11 01:37:40.607016 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.606990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42dd7273-4084-4f7d-860b-65026ad36ab3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7\" (UID: \"42dd7273-4084-4f7d-860b-65026ad36ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"
Jul 11 01:37:40.607563 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.607545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42dd7273-4084-4f7d-860b-65026ad36ab3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7\" (UID: \"42dd7273-4084-4f7d-860b-65026ad36ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"
Jul 11 01:37:40.719180 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.719120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"
Jul 11 01:37:40.846104 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:40.846080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"]
Jul 11 01:37:40.847854 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:37:40.847818    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42dd7273_4084_4f7d_860b_65026ad36ab3.slice/crio-e78523d11d8c6a9808373ad976a6ff7c1dacfa8022827e56e2545da53eb09829 WatchSource:0}: Error finding container e78523d11d8c6a9808373ad976a6ff7c1dacfa8022827e56e2545da53eb09829: Status 404 returned error can't find the container with id e78523d11d8c6a9808373ad976a6ff7c1dacfa8022827e56e2545da53eb09829
Jul 11 01:37:41.559480 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:41.559443    2563 generic.go:356] "Generic (PLEG): container finished" podID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerID="522734b2c8735b8726b8f4b07adc6928307abcd0f555d2ca360fdd01de66de94" exitCode=7
Jul 11 01:37:41.559842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:41.559519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" event={"ID":"42dd7273-4084-4f7d-860b-65026ad36ab3","Type":"ContainerDied","Data":"522734b2c8735b8726b8f4b07adc6928307abcd0f555d2ca360fdd01de66de94"}
Jul 11 01:37:41.559842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:41.559568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" event={"ID":"42dd7273-4084-4f7d-860b-65026ad36ab3","Type":"ContainerStarted","Data":"e78523d11d8c6a9808373ad976a6ff7c1dacfa8022827e56e2545da53eb09829"}
Jul 11 01:37:41.559842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:41.559715    2563 scope.go:117] "RemoveContainer" containerID="522734b2c8735b8726b8f4b07adc6928307abcd0f555d2ca360fdd01de66de94"
Jul 11 01:37:42.566435 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:42.566357    2563 generic.go:356] "Generic (PLEG): container finished" podID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerID="6df195159c333056123d16ba7eec2738b1f4ebf17d47cfb8b62aea5abe9fabd7" exitCode=7
Jul 11 01:37:42.566435 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:42.566413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" event={"ID":"42dd7273-4084-4f7d-860b-65026ad36ab3","Type":"ContainerDied","Data":"6df195159c333056123d16ba7eec2738b1f4ebf17d47cfb8b62aea5abe9fabd7"}
Jul 11 01:37:42.566877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:42.566471    2563 scope.go:117] "RemoveContainer" containerID="522734b2c8735b8726b8f4b07adc6928307abcd0f555d2ca360fdd01de66de94"
Jul 11 01:37:42.566877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:42.566641    2563 scope.go:117] "RemoveContainer" containerID="6df195159c333056123d16ba7eec2738b1f4ebf17d47cfb8b62aea5abe9fabd7"
Jul 11 01:37:42.566970 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:37:42.566918    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7_odh-ai-gateway-infra(42dd7273-4084-4f7d-860b-65026ad36ab3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3"
Jul 11 01:37:43.548740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:43.548706    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:37:43.574634 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:43.574611    2563 scope.go:117] "RemoveContainer" containerID="6df195159c333056123d16ba7eec2738b1f4ebf17d47cfb8b62aea5abe9fabd7"
Jul 11 01:37:43.575085 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:37:43.574812    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7_odh-ai-gateway-infra(42dd7273-4084-4f7d-860b-65026ad36ab3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3"
Jul 11 01:37:45.531906 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:45.531869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:45.634023 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:45.633988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:48.809892 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:48.809843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:37:55.049676 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:55.049644    2563 scope.go:117] "RemoveContainer" containerID="6df195159c333056123d16ba7eec2738b1f4ebf17d47cfb8b62aea5abe9fabd7"
Jul 11 01:37:55.641896 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:55.641858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" event={"ID":"42dd7273-4084-4f7d-860b-65026ad36ab3","Type":"ContainerStarted","Data":"15c036fe6fe836fd50835525e838a6183787b94654dd0d48cc2fbed9e506afeb"}
Jul 11 01:37:55.657717 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:55.657660    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" podStartSLOduration=15.657646383 podStartE2EDuration="15.657646383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:37:55.655591549 +0000 UTC m=+1914.208827455" watchObservedRunningTime="2026-07-11 01:37:55.657646383 +0000 UTC m=+1914.210882288"
Jul 11 01:37:56.654531 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:56.654497    2563 generic.go:356] "Generic (PLEG): container finished" podID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerID="15c036fe6fe836fd50835525e838a6183787b94654dd0d48cc2fbed9e506afeb" exitCode=0
Jul 11 01:37:56.654958 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:56.654555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" event={"ID":"42dd7273-4084-4f7d-860b-65026ad36ab3","Type":"ContainerDied","Data":"15c036fe6fe836fd50835525e838a6183787b94654dd0d48cc2fbed9e506afeb"}
Jul 11 01:37:56.654958 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:56.654626    2563 scope.go:117] "RemoveContainer" containerID="6df195159c333056123d16ba7eec2738b1f4ebf17d47cfb8b62aea5abe9fabd7"
Jul 11 01:37:56.665433 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:56.665404    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"]
Jul 11 01:37:57.792463 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:57.792440    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"
Jul 11 01:37:57.964570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:57.964486    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42dd7273-4084-4f7d-860b-65026ad36ab3-maas-api-service-ca\") pod \"42dd7273-4084-4f7d-860b-65026ad36ab3\" (UID: \"42dd7273-4084-4f7d-860b-65026ad36ab3\") "
Jul 11 01:37:57.964862 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:57.964841    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42dd7273-4084-4f7d-860b-65026ad36ab3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42dd7273-4084-4f7d-860b-65026ad36ab3" (UID: "42dd7273-4084-4f7d-860b-65026ad36ab3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:37:58.065469 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:58.065448    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42dd7273-4084-4f7d-860b-65026ad36ab3-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:37:58.668274 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:58.668248    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"
Jul 11 01:37:58.668437 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:58.668250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7" event={"ID":"42dd7273-4084-4f7d-860b-65026ad36ab3","Type":"ContainerDied","Data":"e78523d11d8c6a9808373ad976a6ff7c1dacfa8022827e56e2545da53eb09829"}
Jul 11 01:37:58.668437 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:58.668379    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e78523d11d8c6a9808373ad976a6ff7c1dacfa8022827e56e2545da53eb09829"
Jul 11 01:37:58.694798 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:58.694770    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"]
Jul 11 01:37:58.700003 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:37:58.699981    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-glsb7"]
Jul 11 01:38:00.056419 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:00.056387    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" path="/var/lib/kubelet/pods/42dd7273-4084-4f7d-860b-65026ad36ab3/volumes"
Jul 11 01:38:30.444728 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.444697    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"]
Jul 11 01:38:30.445173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.445054    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:30.445173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.445066    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:30.445173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.445089    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:30.445173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.445096    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:30.445173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.445154    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:30.445173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.445164    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:30.445173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.445170    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:30.448386 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.448370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"
Jul 11 01:38:30.454410 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.454390    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:38:30.458336 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.458316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"]
Jul 11 01:38:30.538424 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.538389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7030d8d4-3029-4de3-9d7d-feeff13c844b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27\" (UID: \"7030d8d4-3029-4de3-9d7d-feeff13c844b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"
Jul 11 01:38:30.639054 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.639023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7030d8d4-3029-4de3-9d7d-feeff13c844b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27\" (UID: \"7030d8d4-3029-4de3-9d7d-feeff13c844b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"
Jul 11 01:38:30.639637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.639619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7030d8d4-3029-4de3-9d7d-feeff13c844b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27\" (UID: \"7030d8d4-3029-4de3-9d7d-feeff13c844b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"
Jul 11 01:38:30.760048 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.759968    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"
Jul 11 01:38:30.888713 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:30.888672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"]
Jul 11 01:38:30.890916 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:38:30.890885    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7030d8d4_3029_4de3_9d7d_feeff13c844b.slice/crio-b174208d905a940059f90df98c6a3a1e0818943f87b7b95f0b376dda7b0eb05c WatchSource:0}: Error finding container b174208d905a940059f90df98c6a3a1e0818943f87b7b95f0b376dda7b0eb05c: Status 404 returned error can't find the container with id b174208d905a940059f90df98c6a3a1e0818943f87b7b95f0b376dda7b0eb05c
Jul 11 01:38:31.839047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:31.838970    2563 generic.go:356] "Generic (PLEG): container finished" podID="7030d8d4-3029-4de3-9d7d-feeff13c844b" containerID="e4e4420b1ee0e1c7c6051f9759f8e890b2625be359412e03341e69d9fb0c5983" exitCode=0
Jul 11 01:38:31.839047 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:31.839034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27" event={"ID":"7030d8d4-3029-4de3-9d7d-feeff13c844b","Type":"ContainerDied","Data":"e4e4420b1ee0e1c7c6051f9759f8e890b2625be359412e03341e69d9fb0c5983"}
Jul 11 01:38:31.839411 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:31.839072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27" event={"ID":"7030d8d4-3029-4de3-9d7d-feeff13c844b","Type":"ContainerStarted","Data":"b174208d905a940059f90df98c6a3a1e0818943f87b7b95f0b376dda7b0eb05c"}
Jul 11 01:38:32.974757 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:32.974735    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"
Jul 11 01:38:33.064657 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:33.064629    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7030d8d4-3029-4de3-9d7d-feeff13c844b-maas-api-service-ca\") pod \"7030d8d4-3029-4de3-9d7d-feeff13c844b\" (UID: \"7030d8d4-3029-4de3-9d7d-feeff13c844b\") "
Jul 11 01:38:33.064952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:33.064931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7030d8d4-3029-4de3-9d7d-feeff13c844b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7030d8d4-3029-4de3-9d7d-feeff13c844b" (UID: "7030d8d4-3029-4de3-9d7d-feeff13c844b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:38:33.166183 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:33.166151    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7030d8d4-3029-4de3-9d7d-feeff13c844b-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:38:33.850285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:33.850259    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27"
Jul 11 01:38:33.850444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:33.850258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27" event={"ID":"7030d8d4-3029-4de3-9d7d-feeff13c844b","Type":"ContainerDied","Data":"b174208d905a940059f90df98c6a3a1e0818943f87b7b95f0b376dda7b0eb05c"}
Jul 11 01:38:33.850444 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:33.850381    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b174208d905a940059f90df98c6a3a1e0818943f87b7b95f0b376dda7b0eb05c"
Jul 11 01:38:40.561702 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:40.561647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:40.669602 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:40.669573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:40.823485 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:40.823407    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"]
Jul 11 01:38:40.823641 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:40.823615    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j" podUID="1327fecd-1496-46f1-9964-fc9b64563e1b" containerName="maas-api" containerID="cri-o://46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2" gracePeriod=30
Jul 11 01:38:40.845032 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:40.845005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:41.068979 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.068958    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:38:41.235455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.235422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls\") pod \"1327fecd-1496-46f1-9964-fc9b64563e1b\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") "
Jul 11 01:38:41.235637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.235498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1327fecd-1496-46f1-9964-fc9b64563e1b-openshift-service-ca\") pod \"1327fecd-1496-46f1-9964-fc9b64563e1b\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") "
Jul 11 01:38:41.235637 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.235537    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hr5d\" (UniqueName: \"kubernetes.io/projected/1327fecd-1496-46f1-9964-fc9b64563e1b-kube-api-access-2hr5d\") pod \"1327fecd-1496-46f1-9964-fc9b64563e1b\" (UID: \"1327fecd-1496-46f1-9964-fc9b64563e1b\") "
Jul 11 01:38:41.235836 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.235812    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1327fecd-1496-46f1-9964-fc9b64563e1b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1327fecd-1496-46f1-9964-fc9b64563e1b" (UID: "1327fecd-1496-46f1-9964-fc9b64563e1b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:38:41.237368 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.237341    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1327fecd-1496-46f1-9964-fc9b64563e1b-kube-api-access-2hr5d" (OuterVolumeSpecName: "kube-api-access-2hr5d") pod "1327fecd-1496-46f1-9964-fc9b64563e1b" (UID: "1327fecd-1496-46f1-9964-fc9b64563e1b"). InnerVolumeSpecName "kube-api-access-2hr5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:38:41.237474 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.237401    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1327fecd-1496-46f1-9964-fc9b64563e1b" (UID: "1327fecd-1496-46f1-9964-fc9b64563e1b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:38:41.336221 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.336182    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1327fecd-1496-46f1-9964-fc9b64563e1b-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:38:41.336221 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.336217    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hr5d\" (UniqueName: \"kubernetes.io/projected/1327fecd-1496-46f1-9964-fc9b64563e1b-kube-api-access-2hr5d\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:38:41.336221 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.336227    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1327fecd-1496-46f1-9964-fc9b64563e1b-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:38:41.890779 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.890746    2563 generic.go:356] "Generic (PLEG): container finished" podID="1327fecd-1496-46f1-9964-fc9b64563e1b" containerID="46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2" exitCode=0
Jul 11 01:38:41.891196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.890794    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"
Jul 11 01:38:41.891196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.890836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j" event={"ID":"1327fecd-1496-46f1-9964-fc9b64563e1b","Type":"ContainerDied","Data":"46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2"}
Jul 11 01:38:41.891196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.890883    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j" event={"ID":"1327fecd-1496-46f1-9964-fc9b64563e1b","Type":"ContainerDied","Data":"3b46b0998413d708180b3942e4403463babb272c2183a8fe22d891835a89bd97"}
Jul 11 01:38:41.891196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.890904    2563 scope.go:117] "RemoveContainer" containerID="46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2"
Jul 11 01:38:41.899953 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.899936    2563 scope.go:117] "RemoveContainer" containerID="46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2"
Jul 11 01:38:41.900189 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:38:41.900169    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2\": container with ID starting with 46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2 not found: ID does not exist" containerID="46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2"
Jul 11 01:38:41.900245 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.900199    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2"} err="failed to get container status \"46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2\": rpc error: code = NotFound desc = could not find container \"46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2\": container with ID starting with 46a742ea5c58c484c7d8a94b0cccb908f831df6d80b64c718609017fd31965a2 not found: ID does not exist"
Jul 11 01:38:41.911202 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.911177    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"]
Jul 11 01:38:41.914557 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:41.914538    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5ecad626-79b68d9895-xtp7j"]
Jul 11 01:38:42.055042 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:42.055014    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1327fecd-1496-46f1-9964-fc9b64563e1b" path="/var/lib/kubelet/pods/1327fecd-1496-46f1-9964-fc9b64563e1b/volumes"
Jul 11 01:38:43.498847 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:43.498814    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:38:46.331880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:46.331846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:46.432870 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:46.432842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:46.551210 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:46.551177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:47.143203 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.143156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:47.244274 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.244238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:47.662342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.662291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:47.759572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.759541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:47.810140 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810108    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"]
Jul 11 01:38:47.810541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810524    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7030d8d4-3029-4de3-9d7d-feeff13c844b" containerName="revoke-keys"
Jul 11 01:38:47.810626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810543    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7030d8d4-3029-4de3-9d7d-feeff13c844b" containerName="revoke-keys"
Jul 11 01:38:47.810626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810555    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:47.810626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810563    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42dd7273-4084-4f7d-860b-65026ad36ab3" containerName="revoke-keys"
Jul 11 01:38:47.810626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810583    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1327fecd-1496-46f1-9964-fc9b64563e1b" containerName="maas-api"
Jul 11 01:38:47.810626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810593    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1327fecd-1496-46f1-9964-fc9b64563e1b" containerName="maas-api"
Jul 11 01:38:47.810906 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810718    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7030d8d4-3029-4de3-9d7d-feeff13c844b" containerName="revoke-keys"
Jul 11 01:38:47.810906 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.810737    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1327fecd-1496-46f1-9964-fc9b64563e1b" containerName="maas-api"
Jul 11 01:38:47.814940 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.814921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:47.818558 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.818530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:38:47.818661 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.818637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:38:47.819194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.819178    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0e2b807a-serving-cert\""
Jul 11 01:38:47.819300 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.819200    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:38:47.835989 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.835968    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"]
Jul 11 01:38:47.913522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:47.913465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:48.004572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.004545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-openshift-service-ca\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.004752 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.004612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh45s\" (UniqueName: \"kubernetes.io/projected/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-kube-api-access-vh45s\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.004752 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.004730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.105996 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.105971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.106117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.106018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-openshift-service-ca\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.106117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.106052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh45s\" (UniqueName: \"kubernetes.io/projected/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-kube-api-access-vh45s\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.106117 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:38:48.106109    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-serving-cert: secret "maas-api-e2e-ait-0e2b807a-serving-cert" not found
Jul 11 01:38:48.106232 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:38:48.106161    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls podName:0f40cc6f-a95b-435c-8ad8-a3da087da5b8 nodeName:}" failed. No retries permitted until 2026-07-11 01:38:48.606147194 +0000 UTC m=+1967.159383079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls") pod "maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl" (UID: "0f40cc6f-a95b-435c-8ad8-a3da087da5b8") : secret "maas-api-e2e-ait-0e2b807a-serving-cert" not found
Jul 11 01:38:48.106669 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.106650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-openshift-service-ca\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.115429 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.115405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh45s\" (UniqueName: \"kubernetes.io/projected/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-kube-api-access-vh45s\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.155970 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.155945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:48.340263 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.340184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:48.438623 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.438595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:48.609439 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.609361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.611875 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.611851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls\") pod \"maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.724542 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.724500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:48.852889 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.852865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"]
Jul 11 01:38:48.854591 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:38:48.854560    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f40cc6f_a95b_435c_8ad8_a3da087da5b8.slice/crio-ebdb1d74fe79467f689f37f8fa7f0605f761e58996e437b6cf3e7de80ad77ff0 WatchSource:0}: Error finding container ebdb1d74fe79467f689f37f8fa7f0605f761e58996e437b6cf3e7de80ad77ff0: Status 404 returned error can't find the container with id ebdb1d74fe79467f689f37f8fa7f0605f761e58996e437b6cf3e7de80ad77ff0
Jul 11 01:38:48.927822 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:48.927791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl" event={"ID":"0f40cc6f-a95b-435c-8ad8-a3da087da5b8","Type":"ContainerStarted","Data":"ebdb1d74fe79467f689f37f8fa7f0605f761e58996e437b6cf3e7de80ad77ff0"}
Jul 11 01:38:49.934624 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:49.934587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl" event={"ID":"0f40cc6f-a95b-435c-8ad8-a3da087da5b8","Type":"ContainerStarted","Data":"e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8"}
Jul 11 01:38:49.935042 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:49.934657    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:49.952655 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:49.952610    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl" podStartSLOduration=2.532962951 podStartE2EDuration="2.952596529s" totalImagesPullingTime="419.633578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:38:49.951466545 +0000 UTC m=+1968.504702473" watchObservedRunningTime="2026-07-11 01:38:49.952596529 +0000 UTC m=+1968.505832435"
Jul 11 01:38:50.438949 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:50.438917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:52.603134 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.603101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:52.704730 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.704704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:52.812407 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.812376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"]
Jul 11 01:38:52.815897 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.815882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"
Jul 11 01:38:52.817962 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.817946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:38:52.822511 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.822486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"]
Jul 11 01:38:52.844730 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.844706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98792246-384d-47d0-a441-7d88c5b4f5d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq\" (UID: \"98792246-384d-47d0-a441-7d88c5b4f5d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"
Jul 11 01:38:52.945297 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.945270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98792246-384d-47d0-a441-7d88c5b4f5d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq\" (UID: \"98792246-384d-47d0-a441-7d88c5b4f5d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"
Jul 11 01:38:52.946080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:52.946059    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98792246-384d-47d0-a441-7d88c5b4f5d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq\" (UID: \"98792246-384d-47d0-a441-7d88c5b4f5d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"
Jul 11 01:38:53.128017 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.127983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"
Jul 11 01:38:53.252511 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.252486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"]
Jul 11 01:38:53.254410 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:38:53.254385    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98792246_384d_47d0_a441_7d88c5b4f5d7.slice/crio-0d53732d5d70d6c11fac034c2f3ceb26273dc14681754735ba2a18c5b79bcdb1 WatchSource:0}: Error finding container 0d53732d5d70d6c11fac034c2f3ceb26273dc14681754735ba2a18c5b79bcdb1: Status 404 returned error can't find the container with id 0d53732d5d70d6c11fac034c2f3ceb26273dc14681754735ba2a18c5b79bcdb1
Jul 11 01:38:53.305025 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.304994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:53.407207 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.407157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:38:53.956082 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.956049    2563 generic.go:356] "Generic (PLEG): container finished" podID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerID="1e7e8721f0a6814f4d371180f5af2b27b8d8fef8acc347466decf6d3893e57bb" exitCode=7
Jul 11 01:38:53.956408 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.956131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq" event={"ID":"98792246-384d-47d0-a441-7d88c5b4f5d7","Type":"ContainerDied","Data":"1e7e8721f0a6814f4d371180f5af2b27b8d8fef8acc347466decf6d3893e57bb"}
Jul 11 01:38:53.956408 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.956173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq" event={"ID":"98792246-384d-47d0-a441-7d88c5b4f5d7","Type":"ContainerStarted","Data":"0d53732d5d70d6c11fac034c2f3ceb26273dc14681754735ba2a18c5b79bcdb1"}
Jul 11 01:38:53.956408 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:53.956264    2563 scope.go:117] "RemoveContainer" containerID="1e7e8721f0a6814f4d371180f5af2b27b8d8fef8acc347466decf6d3893e57bb"
Jul 11 01:38:54.963249 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:54.963219    2563 generic.go:356] "Generic (PLEG): container finished" podID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerID="0ed4f389aca90f1178b3e53bbb93ac0e92e0c16d7ec639b9d37574ba4d908a71" exitCode=7
Jul 11 01:38:54.963654 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:54.963288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq" event={"ID":"98792246-384d-47d0-a441-7d88c5b4f5d7","Type":"ContainerDied","Data":"0ed4f389aca90f1178b3e53bbb93ac0e92e0c16d7ec639b9d37574ba4d908a71"}
Jul 11 01:38:54.964301 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:54.963337    2563 scope.go:117] "RemoveContainer" containerID="1e7e8721f0a6814f4d371180f5af2b27b8d8fef8acc347466decf6d3893e57bb"
Jul 11 01:38:54.964373 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:54.964364    2563 scope.go:117] "RemoveContainer" containerID="0ed4f389aca90f1178b3e53bbb93ac0e92e0c16d7ec639b9d37574ba4d908a71"
Jul 11 01:38:54.964603 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:38:54.964578    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq_odh-ai-gateway-infra(98792246-384d-47d0-a441-7d88c5b4f5d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7"
Jul 11 01:38:55.945598 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:55.945570    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:38:55.970558 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:55.970529    2563 scope.go:117] "RemoveContainer" containerID="0ed4f389aca90f1178b3e53bbb93ac0e92e0c16d7ec639b9d37574ba4d908a71"
Jul 11 01:38:55.970940 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:38:55.970765    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq_odh-ai-gateway-infra(98792246-384d-47d0-a441-7d88c5b4f5d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7"
Jul 11 01:38:57.199699 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:38:57.199662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:39:09.049457 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:09.049423    2563 scope.go:117] "RemoveContainer" containerID="0ed4f389aca90f1178b3e53bbb93ac0e92e0c16d7ec639b9d37574ba4d908a71"
Jul 11 01:39:10.043479 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:10.043390    2563 generic.go:356] "Generic (PLEG): container finished" podID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerID="9cc2acb51748a1d80637976ce3410faf908da77d788c92aa697f519a1e437578" exitCode=0
Jul 11 01:39:10.043619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:10.043474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq" event={"ID":"98792246-384d-47d0-a441-7d88c5b4f5d7","Type":"ContainerDied","Data":"9cc2acb51748a1d80637976ce3410faf908da77d788c92aa697f519a1e437578"}
Jul 11 01:39:10.043619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:10.043540    2563 scope.go:117] "RemoveContainer" containerID="0ed4f389aca90f1178b3e53bbb93ac0e92e0c16d7ec639b9d37574ba4d908a71"
Jul 11 01:39:11.072675 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:11.072643    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"]
Jul 11 01:39:11.184624 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:11.184602    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"
Jul 11 01:39:11.303281 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:11.303191    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98792246-384d-47d0-a441-7d88c5b4f5d7-maas-api-service-ca\") pod \"98792246-384d-47d0-a441-7d88c5b4f5d7\" (UID: \"98792246-384d-47d0-a441-7d88c5b4f5d7\") "
Jul 11 01:39:11.303616 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:11.303586    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98792246-384d-47d0-a441-7d88c5b4f5d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98792246-384d-47d0-a441-7d88c5b4f5d7" (UID: "98792246-384d-47d0-a441-7d88c5b4f5d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:39:11.404729 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:11.404666    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98792246-384d-47d0-a441-7d88c5b4f5d7-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:39:12.063260 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:12.063222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq" event={"ID":"98792246-384d-47d0-a441-7d88c5b4f5d7","Type":"ContainerDied","Data":"0d53732d5d70d6c11fac034c2f3ceb26273dc14681754735ba2a18c5b79bcdb1"}
Jul 11 01:39:12.063433 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:12.063291    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d53732d5d70d6c11fac034c2f3ceb26273dc14681754735ba2a18c5b79bcdb1"
Jul 11 01:39:12.063433 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:12.063245    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"
Jul 11 01:39:12.090670 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:12.090639    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"]
Jul 11 01:39:12.094232 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:12.094208    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-vqjpq"]
Jul 11 01:39:14.055430 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:14.055389    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" path="/var/lib/kubelet/pods/98792246-384d-47d0-a441-7d88c5b4f5d7/volumes"
Jul 11 01:39:53.358315 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.358278    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"]
Jul 11 01:39:53.359219 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.358525    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl" podUID="0f40cc6f-a95b-435c-8ad8-a3da087da5b8" containerName="maas-api" containerID="cri-o://e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8" gracePeriod=30
Jul 11 01:39:53.381705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.381661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:39:53.604667 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.604644    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:39:53.668784 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.668752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-openshift-service-ca\") pod \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") "
Jul 11 01:39:53.668932 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.668791    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls\") pod \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") "
Jul 11 01:39:53.668932 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.668846    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh45s\" (UniqueName: \"kubernetes.io/projected/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-kube-api-access-vh45s\") pod \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\" (UID: \"0f40cc6f-a95b-435c-8ad8-a3da087da5b8\") "
Jul 11 01:39:53.669170 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.669145    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0f40cc6f-a95b-435c-8ad8-a3da087da5b8" (UID: "0f40cc6f-a95b-435c-8ad8-a3da087da5b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:39:53.671019 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.670992    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-kube-api-access-vh45s" (OuterVolumeSpecName: "kube-api-access-vh45s") pod "0f40cc6f-a95b-435c-8ad8-a3da087da5b8" (UID: "0f40cc6f-a95b-435c-8ad8-a3da087da5b8"). InnerVolumeSpecName "kube-api-access-vh45s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:39:53.671098 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.671049    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0f40cc6f-a95b-435c-8ad8-a3da087da5b8" (UID: "0f40cc6f-a95b-435c-8ad8-a3da087da5b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:39:53.769663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.769612    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:39:53.769663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.769659    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:39:53.769663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:53.769672    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh45s\" (UniqueName: \"kubernetes.io/projected/0f40cc6f-a95b-435c-8ad8-a3da087da5b8-kube-api-access-vh45s\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:39:54.275470 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.275438    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f40cc6f-a95b-435c-8ad8-a3da087da5b8" containerID="e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8" exitCode=0
Jul 11 01:39:54.275646 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.275483    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"
Jul 11 01:39:54.275646 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.275523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl" event={"ID":"0f40cc6f-a95b-435c-8ad8-a3da087da5b8","Type":"ContainerDied","Data":"e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8"}
Jul 11 01:39:54.275646 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.275584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl" event={"ID":"0f40cc6f-a95b-435c-8ad8-a3da087da5b8","Type":"ContainerDied","Data":"ebdb1d74fe79467f689f37f8fa7f0605f761e58996e437b6cf3e7de80ad77ff0"}
Jul 11 01:39:54.275646 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.275612    2563 scope.go:117] "RemoveContainer" containerID="e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8"
Jul 11 01:39:54.284554 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.284536    2563 scope.go:117] "RemoveContainer" containerID="e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8"
Jul 11 01:39:54.284803 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:39:54.284784    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8\": container with ID starting with e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8 not found: ID does not exist" containerID="e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8"
Jul 11 01:39:54.284863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.284811    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8"} err="failed to get container status \"e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8\": rpc error: code = NotFound desc = could not find container \"e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8\": container with ID starting with e18b7aef5aa1b96c01d74d49aea6a31ce2afc99506290d0c0c1befdcdadc32c8 not found: ID does not exist"
Jul 11 01:39:54.289728 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.289706    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"]
Jul 11 01:39:54.292972 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:54.292954    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0e2b807a-b9d74bc67-zrhsl"]
Jul 11 01:39:56.055228 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:56.055197    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f40cc6f-a95b-435c-8ad8-a3da087da5b8" path="/var/lib/kubelet/pods/0f40cc6f-a95b-435c-8ad8-a3da087da5b8/volumes"
Jul 11 01:39:56.303825 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:56.303791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:39:57.932070 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:39:57.932041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:03.661222 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:03.661180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:03.765533 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:03.765493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:08.943939 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:08.943899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:09.225825 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:09.225790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:10.331984 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.331944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:10.434648 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.434615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:10.497573 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497540    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"]
Jul 11 01:40:10.497952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497939    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f40cc6f-a95b-435c-8ad8-a3da087da5b8" containerName="maas-api"
Jul 11 01:40:10.498002 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497953    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f40cc6f-a95b-435c-8ad8-a3da087da5b8" containerName="maas-api"
Jul 11 01:40:10.498002 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497963    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498002 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497968    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498002 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497986    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498002 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497992    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498002 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.497998    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498002 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.498003    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.498066    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.498090    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.498098    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98792246-384d-47d0-a441-7d88c5b4f5d7" containerName="revoke-keys"
Jul 11 01:40:10.498212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.498104    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f40cc6f-a95b-435c-8ad8-a3da087da5b8" containerName="maas-api"
Jul 11 01:40:10.501322 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.501303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.504562 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.504540    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5db4a968-serving-cert\""
Jul 11 01:40:10.504890 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.504874    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:40:10.505492 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.505475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:40:10.505728 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.505713    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:40:10.516758 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.516735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"]
Jul 11 01:40:10.564880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.564836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:10.630882 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.630844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-openshift-service-ca\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.631071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.630915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvzzr\" (UniqueName: \"kubernetes.io/projected/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-kube-api-access-lvzzr\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.631071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.630981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-maas-api-tls\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.653980 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.653950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:10.731871 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.731834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-maas-api-tls\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.732046 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.731914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-openshift-service-ca\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.732046 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.731962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvzzr\" (UniqueName: \"kubernetes.io/projected/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-kube-api-access-lvzzr\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.732631 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.732606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-openshift-service-ca\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.734339 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.734316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-maas-api-tls\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.740803 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.740774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvzzr\" (UniqueName: \"kubernetes.io/projected/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-kube-api-access-lvzzr\") pod \"maas-api-e2e-derive-5db4a968-775dcfd494-xklbj\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.811749 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.811709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:10.946891 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:10.946869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"]
Jul 11 01:40:10.949390 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:40:10.949345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f61012_3188_43b3_9a3e_bcb44bbd67e3.slice/crio-34a327876a632ce485836f84720b67b21236ea44b1be669109b18b39bcf57f36 WatchSource:0}: Error finding container 34a327876a632ce485836f84720b67b21236ea44b1be669109b18b39bcf57f36: Status 404 returned error can't find the container with id 34a327876a632ce485836f84720b67b21236ea44b1be669109b18b39bcf57f36
Jul 11 01:40:11.013908 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:11.013869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:11.114157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:11.114122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:11.365222 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:11.365132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj" event={"ID":"c3f61012-3188-43b3-9a3e-bcb44bbd67e3","Type":"ContainerStarted","Data":"34a327876a632ce485836f84720b67b21236ea44b1be669109b18b39bcf57f36"}
Jul 11 01:40:12.370937 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:12.370898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj" event={"ID":"c3f61012-3188-43b3-9a3e-bcb44bbd67e3","Type":"ContainerStarted","Data":"61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505"}
Jul 11 01:40:12.371343 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:12.371053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:12.389560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:12.388352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj" podStartSLOduration=1.84165735 podStartE2EDuration="2.388331682s" totalImagesPullingTime="546.674332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:40:12.384729584 +0000 UTC m=+2050.937965518" watchObservedRunningTime="2026-07-11 01:40:12.388331682 +0000 UTC m=+2050.941567591"
Jul 11 01:40:13.108286 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:13.108250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:40:14.730423 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:14.730389    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"]
Jul 11 01:40:14.734233 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:14.734216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"
Jul 11 01:40:14.736859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:14.736834    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:40:14.739541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:14.739510    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"]
Jul 11 01:40:14.872618 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:14.872573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c915f-16dd-43b4-9d2f-0aea02d092ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw\" (UID: \"968c915f-16dd-43b4-9d2f-0aea02d092ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"
Jul 11 01:40:14.973304 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:14.973265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c915f-16dd-43b4-9d2f-0aea02d092ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw\" (UID: \"968c915f-16dd-43b4-9d2f-0aea02d092ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"
Jul 11 01:40:14.973917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:14.973897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c915f-16dd-43b4-9d2f-0aea02d092ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw\" (UID: \"968c915f-16dd-43b4-9d2f-0aea02d092ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"
Jul 11 01:40:15.046293 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:15.046200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"
Jul 11 01:40:15.188762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:15.188742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"]
Jul 11 01:40:15.190308 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:40:15.190281    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968c915f_16dd_43b4_9d2f_0aea02d092ad.slice/crio-49acb0e4069227f806c4b8eb0cef743ddf432dcd61343d65033a30b2c6467a96 WatchSource:0}: Error finding container 49acb0e4069227f806c4b8eb0cef743ddf432dcd61343d65033a30b2c6467a96: Status 404 returned error can't find the container with id 49acb0e4069227f806c4b8eb0cef743ddf432dcd61343d65033a30b2c6467a96
Jul 11 01:40:15.388886 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:15.388857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" event={"ID":"968c915f-16dd-43b4-9d2f-0aea02d092ad","Type":"ContainerStarted","Data":"6bafd76ca730450054ba4a84517e17a45c29e144ea8d10ac92a7db8e2e4b8f72"}
Jul 11 01:40:15.389009 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:15.388909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" event={"ID":"968c915f-16dd-43b4-9d2f-0aea02d092ad","Type":"ContainerStarted","Data":"49acb0e4069227f806c4b8eb0cef743ddf432dcd61343d65033a30b2c6467a96"}
Jul 11 01:40:15.403246 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:15.403196    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" podStartSLOduration=1.403180885 podStartE2EDuration="1.403180885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:40:15.401557151 +0000 UTC m=+2053.954793093" watchObservedRunningTime="2026-07-11 01:40:15.403180885 +0000 UTC m=+2053.956416791"
Jul 11 01:40:15.524056 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:15.524025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:15.624902 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:15.624869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:16.395105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:16.395074    2563 generic.go:356] "Generic (PLEG): container finished" podID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerID="6bafd76ca730450054ba4a84517e17a45c29e144ea8d10ac92a7db8e2e4b8f72" exitCode=7
Jul 11 01:40:16.395590 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:16.395118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" event={"ID":"968c915f-16dd-43b4-9d2f-0aea02d092ad","Type":"ContainerDied","Data":"6bafd76ca730450054ba4a84517e17a45c29e144ea8d10ac92a7db8e2e4b8f72"}
Jul 11 01:40:16.395590 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:16.395393    2563 scope.go:117] "RemoveContainer" containerID="6bafd76ca730450054ba4a84517e17a45c29e144ea8d10ac92a7db8e2e4b8f72"
Jul 11 01:40:17.409175 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:17.409128    2563 generic.go:356] "Generic (PLEG): container finished" podID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerID="cb080102c650dde1d275a113d3cd6fd0c31e8486f66b7248559fde6c3160a107" exitCode=7
Jul 11 01:40:17.409736 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:17.409256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" event={"ID":"968c915f-16dd-43b4-9d2f-0aea02d092ad","Type":"ContainerDied","Data":"cb080102c650dde1d275a113d3cd6fd0c31e8486f66b7248559fde6c3160a107"}
Jul 11 01:40:17.409736 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:17.409369    2563 scope.go:117] "RemoveContainer" containerID="6bafd76ca730450054ba4a84517e17a45c29e144ea8d10ac92a7db8e2e4b8f72"
Jul 11 01:40:17.409736 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:17.409714    2563 scope.go:117] "RemoveContainer" containerID="cb080102c650dde1d275a113d3cd6fd0c31e8486f66b7248559fde6c3160a107"
Jul 11 01:40:17.410115 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:40:17.410081    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw_odh-ai-gateway-infra(968c915f-16dd-43b4-9d2f-0aea02d092ad)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad"
Jul 11 01:40:18.382814 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:18.382781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:40:18.418001 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:18.417974    2563 scope.go:117] "RemoveContainer" containerID="cb080102c650dde1d275a113d3cd6fd0c31e8486f66b7248559fde6c3160a107"
Jul 11 01:40:18.418379 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:40:18.418213    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw_odh-ai-gateway-infra(968c915f-16dd-43b4-9d2f-0aea02d092ad)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad"
Jul 11 01:40:18.720088 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:18.720051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:40:34.050311 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:34.050224    2563 scope.go:117] "RemoveContainer" containerID="cb080102c650dde1d275a113d3cd6fd0c31e8486f66b7248559fde6c3160a107"
Jul 11 01:40:34.503649 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:34.503613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" event={"ID":"968c915f-16dd-43b4-9d2f-0aea02d092ad","Type":"ContainerStarted","Data":"dd418fead0b1438c4db2aae5626897d316ac5e337b040b3fdca10912133a95de"}
Jul 11 01:40:35.510745 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:35.510713    2563 generic.go:356] "Generic (PLEG): container finished" podID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerID="dd418fead0b1438c4db2aae5626897d316ac5e337b040b3fdca10912133a95de" exitCode=0
Jul 11 01:40:35.511173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:35.510788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" event={"ID":"968c915f-16dd-43b4-9d2f-0aea02d092ad","Type":"ContainerDied","Data":"dd418fead0b1438c4db2aae5626897d316ac5e337b040b3fdca10912133a95de"}
Jul 11 01:40:35.511173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:35.510850    2563 scope.go:117] "RemoveContainer" containerID="cb080102c650dde1d275a113d3cd6fd0c31e8486f66b7248559fde6c3160a107"
Jul 11 01:40:35.526101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:35.526073    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"]
Jul 11 01:40:36.650361 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:36.650339    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"
Jul 11 01:40:36.773199 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:36.773119    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c915f-16dd-43b4-9d2f-0aea02d092ad-maas-api-service-ca\") pod \"968c915f-16dd-43b4-9d2f-0aea02d092ad\" (UID: \"968c915f-16dd-43b4-9d2f-0aea02d092ad\") "
Jul 11 01:40:36.773463 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:36.773440    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968c915f-16dd-43b4-9d2f-0aea02d092ad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "968c915f-16dd-43b4-9d2f-0aea02d092ad" (UID: "968c915f-16dd-43b4-9d2f-0aea02d092ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:40:36.874764 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:36.874729    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c915f-16dd-43b4-9d2f-0aea02d092ad-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:40:37.523638 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:37.523602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw" event={"ID":"968c915f-16dd-43b4-9d2f-0aea02d092ad","Type":"ContainerDied","Data":"49acb0e4069227f806c4b8eb0cef743ddf432dcd61343d65033a30b2c6467a96"}
Jul 11 01:40:37.523638 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:37.523623    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"
Jul 11 01:40:37.523920 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:37.523660    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49acb0e4069227f806c4b8eb0cef743ddf432dcd61343d65033a30b2c6467a96"
Jul 11 01:40:37.555511 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:37.555480    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"]
Jul 11 01:40:37.559608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:37.559584    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-5j5cw"]
Jul 11 01:40:38.055939 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:40:38.055900    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" path="/var/lib/kubelet/pods/968c915f-16dd-43b4-9d2f-0aea02d092ad/volumes"
Jul 11 01:41:02.068814 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:02.068787    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:41:02.070554 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:02.070526    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:41:02.074748 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:02.074727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:41:02.076201 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:02.076181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:41:14.770107 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.770068    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"]
Jul 11 01:41:14.770530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.770489    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:41:14.770530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.770500    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:41:14.770530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.770509    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:41:14.770530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.770514    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:41:14.770659 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.770589    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:41:14.770659 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.770599    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:41:14.773758 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.773742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"
Jul 11 01:41:14.775790 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.775772    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:41:14.779291 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.779260    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"]
Jul 11 01:41:14.816152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.816116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f25c42-0c4d-4486-a714-de86db247562-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5db4a968-jljhv\" (UID: \"43f25c42-0c4d-4486-a714-de86db247562\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"
Jul 11 01:41:14.916971 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.916930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f25c42-0c4d-4486-a714-de86db247562-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5db4a968-jljhv\" (UID: \"43f25c42-0c4d-4486-a714-de86db247562\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"
Jul 11 01:41:14.917619 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:14.917599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f25c42-0c4d-4486-a714-de86db247562-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5db4a968-jljhv\" (UID: \"43f25c42-0c4d-4486-a714-de86db247562\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"
Jul 11 01:41:15.085938 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:15.085839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"
Jul 11 01:41:15.222128 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:15.222101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"]
Jul 11 01:41:15.224100 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:41:15.224063    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f25c42_0c4d_4486_a714_de86db247562.slice/crio-38ee44413d0df69d6b227109ea1df99e622ce3bfb3b5352ee12bef075a656036 WatchSource:0}: Error finding container 38ee44413d0df69d6b227109ea1df99e622ce3bfb3b5352ee12bef075a656036: Status 404 returned error can't find the container with id 38ee44413d0df69d6b227109ea1df99e622ce3bfb3b5352ee12bef075a656036
Jul 11 01:41:15.723983 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:15.723899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv" event={"ID":"43f25c42-0c4d-4486-a714-de86db247562","Type":"ContainerStarted","Data":"e285c94cc7cc005093890b094f9618d3030e4cf70a730ff1926b6f5320795071"}
Jul 11 01:41:15.723983 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:15.723946    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv" event={"ID":"43f25c42-0c4d-4486-a714-de86db247562","Type":"ContainerStarted","Data":"38ee44413d0df69d6b227109ea1df99e622ce3bfb3b5352ee12bef075a656036"}
Jul 11 01:41:15.739397 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:15.739351    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv" podStartSLOduration=1.739336397 podStartE2EDuration="1.739336397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:41:15.737230274 +0000 UTC m=+2114.290466206" watchObservedRunningTime="2026-07-11 01:41:15.739336397 +0000 UTC m=+2114.292572354"
Jul 11 01:41:16.730322 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:16.730289    2563 generic.go:356] "Generic (PLEG): container finished" podID="43f25c42-0c4d-4486-a714-de86db247562" containerID="e285c94cc7cc005093890b094f9618d3030e4cf70a730ff1926b6f5320795071" exitCode=0
Jul 11 01:41:16.730765 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:16.730368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv" event={"ID":"43f25c42-0c4d-4486-a714-de86db247562","Type":"ContainerDied","Data":"e285c94cc7cc005093890b094f9618d3030e4cf70a730ff1926b6f5320795071"}
Jul 11 01:41:17.871801 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:17.871777    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"
Jul 11 01:41:17.948945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:17.948912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f25c42-0c4d-4486-a714-de86db247562-maas-api-service-ca\") pod \"43f25c42-0c4d-4486-a714-de86db247562\" (UID: \"43f25c42-0c4d-4486-a714-de86db247562\") "
Jul 11 01:41:17.949306 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:17.949285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43f25c42-0c4d-4486-a714-de86db247562-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43f25c42-0c4d-4486-a714-de86db247562" (UID: "43f25c42-0c4d-4486-a714-de86db247562"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:41:18.049790 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:18.049712    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f25c42-0c4d-4486-a714-de86db247562-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:41:18.742049 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:18.742013    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv"
Jul 11 01:41:18.742230 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:18.742068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5db4a968-jljhv" event={"ID":"43f25c42-0c4d-4486-a714-de86db247562","Type":"ContainerDied","Data":"38ee44413d0df69d6b227109ea1df99e622ce3bfb3b5352ee12bef075a656036"}
Jul 11 01:41:18.742230 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:18.742123    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38ee44413d0df69d6b227109ea1df99e622ce3bfb3b5352ee12bef075a656036"
Jul 11 01:41:25.131536 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.131505    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"]
Jul 11 01:41:25.131989 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.131728    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj" podUID="c3f61012-3188-43b3-9a3e-bcb44bbd67e3" containerName="maas-api" containerID="cri-o://61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505" gracePeriod=30
Jul 11 01:41:25.158301 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.158274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:25.388623 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.388561    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:41:25.522978 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.522935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-maas-api-tls\") pod \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") "
Jul 11 01:41:25.523184 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.523035    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvzzr\" (UniqueName: \"kubernetes.io/projected/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-kube-api-access-lvzzr\") pod \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") "
Jul 11 01:41:25.523184 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.523065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-openshift-service-ca\") pod \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\" (UID: \"c3f61012-3188-43b3-9a3e-bcb44bbd67e3\") "
Jul 11 01:41:25.523511 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.523482    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3f61012-3188-43b3-9a3e-bcb44bbd67e3" (UID: "c3f61012-3188-43b3-9a3e-bcb44bbd67e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:41:25.525186 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.525167    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3f61012-3188-43b3-9a3e-bcb44bbd67e3" (UID: "c3f61012-3188-43b3-9a3e-bcb44bbd67e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:41:25.525258 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.525220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-kube-api-access-lvzzr" (OuterVolumeSpecName: "kube-api-access-lvzzr") pod "c3f61012-3188-43b3-9a3e-bcb44bbd67e3" (UID: "c3f61012-3188-43b3-9a3e-bcb44bbd67e3"). InnerVolumeSpecName "kube-api-access-lvzzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:41:25.624151 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.624117    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvzzr\" (UniqueName: \"kubernetes.io/projected/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-kube-api-access-lvzzr\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:41:25.624151 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.624146    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:41:25.624151 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.624156    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f61012-3188-43b3-9a3e-bcb44bbd67e3-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:41:25.779916 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.779832    2563 generic.go:356] "Generic (PLEG): container finished" podID="c3f61012-3188-43b3-9a3e-bcb44bbd67e3" containerID="61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505" exitCode=0
Jul 11 01:41:25.779916 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.779879    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"
Jul 11 01:41:25.780096 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.779920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj" event={"ID":"c3f61012-3188-43b3-9a3e-bcb44bbd67e3","Type":"ContainerDied","Data":"61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505"}
Jul 11 01:41:25.780096 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.779973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj" event={"ID":"c3f61012-3188-43b3-9a3e-bcb44bbd67e3","Type":"ContainerDied","Data":"34a327876a632ce485836f84720b67b21236ea44b1be669109b18b39bcf57f36"}
Jul 11 01:41:25.780096 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.779998    2563 scope.go:117] "RemoveContainer" containerID="61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505"
Jul 11 01:41:25.790137 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.790120    2563 scope.go:117] "RemoveContainer" containerID="61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505"
Jul 11 01:41:25.790413 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:41:25.790396    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505\": container with ID starting with 61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505 not found: ID does not exist" containerID="61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505"
Jul 11 01:41:25.790460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.790422    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505"} err="failed to get container status \"61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505\": rpc error: code = NotFound desc = could not find container \"61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505\": container with ID starting with 61853924b6ed09415ba1b6e00150847480a5b5bebc31677ed20b24322b7b5505 not found: ID does not exist"
Jul 11 01:41:25.813305 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.813277    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"]
Jul 11 01:41:25.818355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:25.818330    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5db4a968-775dcfd494-xklbj"]
Jul 11 01:41:26.055617 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:26.055535    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f61012-3188-43b3-9a3e-bcb44bbd67e3" path="/var/lib/kubelet/pods/c3f61012-3188-43b3-9a3e-bcb44bbd67e3/volumes"
Jul 11 01:41:28.201826 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:28.201794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:41:29.846502 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:29.846455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:35.486716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:35.486662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:35.541288 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:35.541251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:40.033836 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:40.033786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:40.610328 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:40.610295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:40.709464 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:40.709432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:40.809153 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:40.809108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:42.204762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:42.204736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:46.552970 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:46.552935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:47.979853 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:47.979778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:48.086811 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:48.086759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:48.180194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:48.180159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:48.280048 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:48.279956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:41:48.670749 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:41:48.670720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:14.629216 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:14.629181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:20.300008 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:20.299969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:20.356594 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:20.356569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:20.432526 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:20.432499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:20.532827 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:20.532796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:36.348240 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:36.348194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:41.876626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:41.876542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:41.988862 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:41.988817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:42.076785 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:42.076754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:52.593703 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:52.593650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:53.399539 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:53.399497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:59.009324 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:59.009284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:59.110907 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:59.110871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:59.210227 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:59.210191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:42:59.310271 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:42:59.310169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:00.049196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:00.049150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:00.149595 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:00.149554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:00.203536 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:00.203495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:01.818976 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:01.818940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:02.148921 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:02.148896    2563 scope.go:117] "RemoveContainer" containerID="1385f0d81c759c4305b6993b86fcea0619461c6ced1bfb89bdf570d9c6aa1601"
Jul 11 01:43:03.503729 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:03.503695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:43:07.389607 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:07.389568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:07.445815 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:07.445782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:08.058339 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:08.058306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:12.709999 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:12.709969    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:43:13.613041 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:13.613007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:13.713956 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:13.713924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:13.841218 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:13.841181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:14.148827 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:14.148774    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:14.471737 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:14.471629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:16.833239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.833199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:16.923901 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.923870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:16.925079 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925061    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"]
Jul 11 01:43:16.925432 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925421    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f25c42-0c4d-4486-a714-de86db247562" containerName="revoke-keys"
Jul 11 01:43:16.925471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925434    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f25c42-0c4d-4486-a714-de86db247562" containerName="revoke-keys"
Jul 11 01:43:16.925471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925445    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f61012-3188-43b3-9a3e-bcb44bbd67e3" containerName="maas-api"
Jul 11 01:43:16.925471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925451    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f61012-3188-43b3-9a3e-bcb44bbd67e3" containerName="maas-api"
Jul 11 01:43:16.925471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925465    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:43:16.925471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925472    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:43:16.925620 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925534    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f61012-3188-43b3-9a3e-bcb44bbd67e3" containerName="maas-api"
Jul 11 01:43:16.925620 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925545    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="968c915f-16dd-43b4-9d2f-0aea02d092ad" containerName="revoke-keys"
Jul 11 01:43:16.925620 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.925551    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f25c42-0c4d-4486-a714-de86db247562" containerName="revoke-keys"
Jul 11 01:43:16.928480 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.928466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:16.930667 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.930644    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:43:16.930801 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.930644    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:43:16.931397 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.931378    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:43:16.931490 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.931387    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-37fb922a-serving-cert\""
Jul 11 01:43:16.937695 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:16.937663    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"]
Jul 11 01:43:17.023022 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.022992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:17.119060 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.118979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40e5446-cc23-4341-a095-2fd1ffafb192-maas-api-tls\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.119231 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.119071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e5446-cc23-4341-a095-2fd1ffafb192-openshift-service-ca\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.119231 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.119100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vlk7\" (UniqueName: \"kubernetes.io/projected/c40e5446-cc23-4341-a095-2fd1ffafb192-kube-api-access-4vlk7\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.182723 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.182674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:17.220093 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.220064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40e5446-cc23-4341-a095-2fd1ffafb192-maas-api-tls\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.220235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.220135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e5446-cc23-4341-a095-2fd1ffafb192-openshift-service-ca\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.220235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.220165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vlk7\" (UniqueName: \"kubernetes.io/projected/c40e5446-cc23-4341-a095-2fd1ffafb192-kube-api-access-4vlk7\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.220819 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.220799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e5446-cc23-4341-a095-2fd1ffafb192-openshift-service-ca\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.222499 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.222476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40e5446-cc23-4341-a095-2fd1ffafb192-maas-api-tls\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.227532 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.227509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vlk7\" (UniqueName: \"kubernetes.io/projected/c40e5446-cc23-4341-a095-2fd1ffafb192-kube-api-access-4vlk7\") pod \"maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.239342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.239325    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:17.376123 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.376092    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"]
Jul 11 01:43:17.377808 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:43:17.377777    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40e5446_cc23_4341_a095_2fd1ffafb192.slice/crio-405b6aa8305b8c8379b52ab4a7163f1126b445db373d9a6e68123691f0a8f7e8 WatchSource:0}: Error finding container 405b6aa8305b8c8379b52ab4a7163f1126b445db373d9a6e68123691f0a8f7e8: Status 404 returned error can't find the container with id 405b6aa8305b8c8379b52ab4a7163f1126b445db373d9a6e68123691f0a8f7e8
Jul 11 01:43:17.379446 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.379429    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:43:17.584608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.584576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:17.685078 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:17.685006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:18.355514 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:18.355436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth" event={"ID":"c40e5446-cc23-4341-a095-2fd1ffafb192","Type":"ContainerStarted","Data":"e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0"}
Jul 11 01:43:18.355514 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:18.355509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth" event={"ID":"c40e5446-cc23-4341-a095-2fd1ffafb192","Type":"ContainerStarted","Data":"405b6aa8305b8c8379b52ab4a7163f1126b445db373d9a6e68123691f0a8f7e8"}
Jul 11 01:43:18.355931 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:18.355574    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:21.319572 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:21.319532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:21.705562 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:21.705510    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth" podStartSLOduration=5.118647404 podStartE2EDuration="5.705493211s" totalImagesPullingTime="586.845807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:43:18.370301312 +0000 UTC m=+2236.923537232" watchObservedRunningTime="2026-07-11 01:43:21.705493211 +0000 UTC m=+2240.258729170"
Jul 11 01:43:21.705867 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:21.705853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:43:21.974324 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:21.974248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:22.072555 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:22.072523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:22.382373 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:22.382347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:24.366130 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:24.366055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:27.988362 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:27.988330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:28.050434 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:28.050406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:38.690445 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:38.690402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"]
Jul 11 01:43:38.690842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:38.690633    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth" podUID="c40e5446-cc23-4341-a095-2fd1ffafb192" containerName="maas-api" containerID="cri-o://e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0" gracePeriod=30
Jul 11 01:43:38.713851 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:38.713828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:38.932984 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:38.932960    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:39.007530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.007452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40e5446-cc23-4341-a095-2fd1ffafb192-maas-api-tls\") pod \"c40e5446-cc23-4341-a095-2fd1ffafb192\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") "
Jul 11 01:43:39.007715 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.007547    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vlk7\" (UniqueName: \"kubernetes.io/projected/c40e5446-cc23-4341-a095-2fd1ffafb192-kube-api-access-4vlk7\") pod \"c40e5446-cc23-4341-a095-2fd1ffafb192\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") "
Jul 11 01:43:39.007715 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.007596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e5446-cc23-4341-a095-2fd1ffafb192-openshift-service-ca\") pod \"c40e5446-cc23-4341-a095-2fd1ffafb192\" (UID: \"c40e5446-cc23-4341-a095-2fd1ffafb192\") "
Jul 11 01:43:39.007982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.007959    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40e5446-cc23-4341-a095-2fd1ffafb192-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c40e5446-cc23-4341-a095-2fd1ffafb192" (UID: "c40e5446-cc23-4341-a095-2fd1ffafb192"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:43:39.009453 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.009431    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c40e5446-cc23-4341-a095-2fd1ffafb192-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c40e5446-cc23-4341-a095-2fd1ffafb192" (UID: "c40e5446-cc23-4341-a095-2fd1ffafb192"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:43:39.009586 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.009564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40e5446-cc23-4341-a095-2fd1ffafb192-kube-api-access-4vlk7" (OuterVolumeSpecName: "kube-api-access-4vlk7") pod "c40e5446-cc23-4341-a095-2fd1ffafb192" (UID: "c40e5446-cc23-4341-a095-2fd1ffafb192"). InnerVolumeSpecName "kube-api-access-4vlk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:43:39.108886 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.108853    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40e5446-cc23-4341-a095-2fd1ffafb192-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:43:39.108886 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.108879    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vlk7\" (UniqueName: \"kubernetes.io/projected/c40e5446-cc23-4341-a095-2fd1ffafb192-kube-api-access-4vlk7\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:43:39.108886 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.108889    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e5446-cc23-4341-a095-2fd1ffafb192-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:43:39.460909 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.460874    2563 generic.go:356] "Generic (PLEG): container finished" podID="c40e5446-cc23-4341-a095-2fd1ffafb192" containerID="e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0" exitCode=0
Jul 11 01:43:39.461115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.460918    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth" event={"ID":"c40e5446-cc23-4341-a095-2fd1ffafb192","Type":"ContainerDied","Data":"e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0"}
Jul 11 01:43:39.461115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.460925    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"
Jul 11 01:43:39.461115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.460999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth" event={"ID":"c40e5446-cc23-4341-a095-2fd1ffafb192","Type":"ContainerDied","Data":"405b6aa8305b8c8379b52ab4a7163f1126b445db373d9a6e68123691f0a8f7e8"}
Jul 11 01:43:39.461115 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.461028    2563 scope.go:117] "RemoveContainer" containerID="e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0"
Jul 11 01:43:39.470863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.470846    2563 scope.go:117] "RemoveContainer" containerID="e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0"
Jul 11 01:43:39.471109 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:43:39.471093    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0\": container with ID starting with e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0 not found: ID does not exist" containerID="e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0"
Jul 11 01:43:39.471145 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.471117    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0"} err="failed to get container status \"e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0\": rpc error: code = NotFound desc = could not find container \"e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0\": container with ID starting with e1781f06856db59bfa8c29ef27b87cc408a869692ea281835602a3eaf7298ab0 not found: ID does not exist"
Jul 11 01:43:39.480755 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.480735    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"]
Jul 11 01:43:39.484310 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:39.484291    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37fb922a-7dd7b67c99-qsbth"]
Jul 11 01:43:40.055841 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:40.055811    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c40e5446-cc23-4341-a095-2fd1ffafb192" path="/var/lib/kubelet/pods/c40e5446-cc23-4341-a095-2fd1ffafb192/volumes"
Jul 11 01:43:41.903145 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:41.903113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:43:43.420299 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:43.420269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:49.159808 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:49.159771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:49.264082 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:49.264051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:53.408856 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:53.408822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:53.509833 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:53.509801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:54.076877 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:54.076848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:54.307705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:54.307648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:54.446229 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:54.446189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:54.545149 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:54.545102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:43:54.655789 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:43:54.655747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:00.368471 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:00.368438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:00.470545 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:00.470511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:00.568071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:00.568037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:00.708661 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:00.708627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:02.169913 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:02.169877    2563 scope.go:117] "RemoveContainer" containerID="15c036fe6fe836fd50835525e838a6183787b94654dd0d48cc2fbed9e506afeb"
Jul 11 01:44:06.637408 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:06.637366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:06.713592 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:06.713555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:13.442224 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:13.442186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:13.741256 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:13.741163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:14.013953 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:14.013862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:16.986129 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:16.986094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:17.071946 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.071915    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"]
Jul 11 01:44:17.072287 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.072266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:17.072360 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.072338    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40e5446-cc23-4341-a095-2fd1ffafb192" containerName="maas-api"
Jul 11 01:44:17.072360 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.072350    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40e5446-cc23-4341-a095-2fd1ffafb192" containerName="maas-api"
Jul 11 01:44:17.072449 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.072424    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40e5446-cc23-4341-a095-2fd1ffafb192" containerName="maas-api"
Jul 11 01:44:17.075489 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.075470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.078291 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.078272    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:44:17.078428 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.078320    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:44:17.079057 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.079043    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-83b6ef8d-serving-cert\""
Jul 11 01:44:17.079114 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.079071    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:44:17.087061 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.087037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"]
Jul 11 01:44:17.140741 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.140703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.140741 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.140742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59p9t\" (UniqueName: \"kubernetes.io/projected/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-kube-api-access-59p9t\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.140980 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.140842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-openshift-service-ca\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.143764 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.143736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:17.242233 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.242134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.242233 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.242174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59p9t\" (UniqueName: \"kubernetes.io/projected/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-kube-api-access-59p9t\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.242233 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.242218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-openshift-service-ca\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.242548 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:44:17.242281    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-serving-cert: secret "maas-api-e2e-mt-83b6ef8d-serving-cert" not found
Jul 11 01:44:17.242548 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:44:17.242357    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls podName:84cfde46-491e-4ec6-bb51-3d70d37c8d4a nodeName:}" failed. No retries permitted until 2026-07-11 01:44:17.742340272 +0000 UTC m=+2296.295576157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls") pod "maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj" (UID: "84cfde46-491e-4ec6-bb51-3d70d37c8d4a") : secret "maas-api-e2e-mt-83b6ef8d-serving-cert" not found
Jul 11 01:44:17.242948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.242926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-openshift-service-ca\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.254663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.254637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59p9t\" (UniqueName: \"kubernetes.io/projected/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-kube-api-access-59p9t\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.444535 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.444502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:17.545559 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.545475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:17.646094 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.646060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:17.746473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.746439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.748843 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.748812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls\") pod \"maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:17.986647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:17.986612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:18.125064 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:18.125038    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"]
Jul 11 01:44:18.127233 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:44:18.127200    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84cfde46_491e_4ec6_bb51_3d70d37c8d4a.slice/crio-6af7a05cedac5a3de3d7bada70fe12a18e9c4904390241db334a7e42426908ae WatchSource:0}: Error finding container 6af7a05cedac5a3de3d7bada70fe12a18e9c4904390241db334a7e42426908ae: Status 404 returned error can't find the container with id 6af7a05cedac5a3de3d7bada70fe12a18e9c4904390241db334a7e42426908ae
Jul 11 01:44:18.664602 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:18.664566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj" event={"ID":"84cfde46-491e-4ec6-bb51-3d70d37c8d4a","Type":"ContainerStarted","Data":"60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b"}
Jul 11 01:44:18.664810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:18.664655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj" event={"ID":"84cfde46-491e-4ec6-bb51-3d70d37c8d4a","Type":"ContainerStarted","Data":"6af7a05cedac5a3de3d7bada70fe12a18e9c4904390241db334a7e42426908ae"}
Jul 11 01:44:18.664810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:18.664698    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:18.683073 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:18.683025    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj" podStartSLOduration=1.321218704 podStartE2EDuration="1.683007824s" totalImagesPullingTime="361.78912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:44:18.681312811 +0000 UTC m=+2297.234548716" watchObservedRunningTime="2026-07-11 01:44:18.683007824 +0000 UTC m=+2297.236243729"
Jul 11 01:44:21.485320 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:21.485284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:22.005202 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:22.005165    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:44:24.674869 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:24.674837    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:44:27.202095 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.202063    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"]
Jul 11 01:44:27.206105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.206083    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.209149 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.209123    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-83b6ef8d\"/\"kube-root-ca.crt\""
Jul 11 01:44:27.209285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.209190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-83b6ef8d\"/\"default-dockercfg-97wjt\""
Jul 11 01:44:27.209285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.209123    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-83b6ef8d\"/\"openshift-service-ca.crt\""
Jul 11 01:44:27.209285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.209264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-83b6ef8d\"/\"e2e-lifecycle-model-83b6ef8d-kserve-self-signed-certs\""
Jul 11 01:44:27.214595 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.214570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"]
Jul 11 01:44:27.228333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.228289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:27.338377 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.338328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj8zn\" (UniqueName: \"kubernetes.io/projected/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-kube-api-access-xj8zn\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.338611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.338394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-home\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.338611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.338428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tmp-dir\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.338611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.338454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tls-certs\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.338611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.338555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-dshm\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.338611 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.338593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-model-cache\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439341 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-dshm\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439341 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-model-cache\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439612 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj8zn\" (UniqueName: \"kubernetes.io/projected/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-kube-api-access-xj8zn\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439612 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-home\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439612 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tmp-dir\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439612 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tls-certs\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439869 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-model-cache\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-home\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.439928 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.439904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tmp-dir\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.441660 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.441640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-dshm\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.441961 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.441943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tls-certs\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.447914 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.447892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj8zn\" (UniqueName: \"kubernetes.io/projected/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-kube-api-access-xj8zn\") pod \"e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") " pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.515832 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.515737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:27.651391 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.651364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"]
Jul 11 01:44:27.653586 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:44:27.653557    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b5a44e1_7d35_40eb_80cf_d124ef8ef6a0.slice/crio-fbd96a3e8409cd7548aa987932b8067269f579fa1ae4972d905616e40c8f702f WatchSource:0}: Error finding container fbd96a3e8409cd7548aa987932b8067269f579fa1ae4972d905616e40c8f702f: Status 404 returned error can't find the container with id fbd96a3e8409cd7548aa987932b8067269f579fa1ae4972d905616e40c8f702f
Jul 11 01:44:27.716922 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.716889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4" event={"ID":"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0","Type":"ContainerStarted","Data":"40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2"}
Jul 11 01:44:27.717065 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.716932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4" event={"ID":"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0","Type":"ContainerStarted","Data":"fbd96a3e8409cd7548aa987932b8067269f579fa1ae4972d905616e40c8f702f"}
Jul 11 01:44:27.736596 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:27.736544    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4" podStartSLOduration=0.736522541 podStartE2EDuration="736.522541ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:44:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:44:27.734819456 +0000 UTC m=+2306.288055391" watchObservedRunningTime="2026-07-11 01:44:27.736522541 +0000 UTC m=+2306.289758446"
Jul 11 01:44:30.911564 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:30.911516    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:44:37.516847 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:37.516800    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:37.516847 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:37.516864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:37.529126 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:37.529099    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:37.778212 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:37.778124    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:44:43.041178 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:43.041138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:44:46.202145 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:46.202112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:44:59.778724 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:59.778626    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"]
Jul 11 01:44:59.779140 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:59.778970    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj" podUID="84cfde46-491e-4ec6-bb51-3d70d37c8d4a" containerName="maas-api" containerID="cri-o://60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b" gracePeriod=30
Jul 11 01:44:59.806193 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:44:59.806158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:00.022621 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.022596    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:45:00.051474 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.051390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59p9t\" (UniqueName: \"kubernetes.io/projected/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-kube-api-access-59p9t\") pod \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") "
Jul 11 01:45:00.051474 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.051450    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls\") pod \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") "
Jul 11 01:45:00.051661 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.051549    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-openshift-service-ca\") pod \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\" (UID: \"84cfde46-491e-4ec6-bb51-3d70d37c8d4a\") "
Jul 11 01:45:00.051921 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.051893    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84cfde46-491e-4ec6-bb51-3d70d37c8d4a" (UID: "84cfde46-491e-4ec6-bb51-3d70d37c8d4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:45:00.053659 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.053627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84cfde46-491e-4ec6-bb51-3d70d37c8d4a" (UID: "84cfde46-491e-4ec6-bb51-3d70d37c8d4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:45:00.053959 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.053934    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-kube-api-access-59p9t" (OuterVolumeSpecName: "kube-api-access-59p9t") pod "84cfde46-491e-4ec6-bb51-3d70d37c8d4a" (UID: "84cfde46-491e-4ec6-bb51-3d70d37c8d4a"). InnerVolumeSpecName "kube-api-access-59p9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:45:00.153666 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.153515    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:00.153666 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.153571    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59p9t\" (UniqueName: \"kubernetes.io/projected/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-kube-api-access-59p9t\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:00.153666 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.153603    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84cfde46-491e-4ec6-bb51-3d70d37c8d4a-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:00.884812 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.884771    2563 generic.go:356] "Generic (PLEG): container finished" podID="84cfde46-491e-4ec6-bb51-3d70d37c8d4a" containerID="60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b" exitCode=0
Jul 11 01:45:00.885239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.884819    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"
Jul 11 01:45:00.885239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.884858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj" event={"ID":"84cfde46-491e-4ec6-bb51-3d70d37c8d4a","Type":"ContainerDied","Data":"60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b"}
Jul 11 01:45:00.885239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.884915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj" event={"ID":"84cfde46-491e-4ec6-bb51-3d70d37c8d4a","Type":"ContainerDied","Data":"6af7a05cedac5a3de3d7bada70fe12a18e9c4904390241db334a7e42426908ae"}
Jul 11 01:45:00.885239 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.884938    2563 scope.go:117] "RemoveContainer" containerID="60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b"
Jul 11 01:45:00.893923 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.893912    2563 scope.go:117] "RemoveContainer" containerID="60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b"
Jul 11 01:45:00.894177 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:45:00.894157    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b\": container with ID starting with 60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b not found: ID does not exist" containerID="60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b"
Jul 11 01:45:00.894254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.894185    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b"} err="failed to get container status \"60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b\": rpc error: code = NotFound desc = could not find container \"60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b\": container with ID starting with 60948075599db095c0cc531734706f824e8489a0737a77c0e9a8e24390d6552b not found: ID does not exist"
Jul 11 01:45:00.899569 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.899549    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"]
Jul 11 01:45:00.903467 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:00.903444    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83b6ef8d-5bc5976dcc-9zcrj"]
Jul 11 01:45:02.055344 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:02.055314    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84cfde46-491e-4ec6-bb51-3d70d37c8d4a" path="/var/lib/kubelet/pods/84cfde46-491e-4ec6-bb51-3d70d37c8d4a/volumes"
Jul 11 01:45:03.706560 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:03.706520    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:45:04.445978 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:04.445936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:08.965455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:08.965420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:09.033249 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:09.033211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:09.436089 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:09.436052    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"]
Jul 11 01:45:09.528843 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:09.528804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:24.456256 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.456194    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4" podUID="2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" containerName="main" containerID="cri-o://40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2" gracePeriod=45
Jul 11 01:45:24.708120 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.708065    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:45:24.884749 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.884710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-dshm\") pod \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") "
Jul 11 01:45:24.884940 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.884800    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj8zn\" (UniqueName: \"kubernetes.io/projected/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-kube-api-access-xj8zn\") pod \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") "
Jul 11 01:45:24.884940 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.884840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tmp-dir\") pod \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") "
Jul 11 01:45:24.884940 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.884860    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-model-cache\") pod \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") "
Jul 11 01:45:24.884940 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.884929    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tls-certs\") pod \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") "
Jul 11 01:45:24.885102 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.884998    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-home\") pod \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\" (UID: \"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0\") "
Jul 11 01:45:24.885145 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.885111    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" (UID: "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:45:24.885188 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.885142    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" (UID: "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:45:24.885322 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.885303    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-home" (OuterVolumeSpecName: "home") pod "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" (UID: "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:45:24.885389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.885345    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tmp-dir\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:24.885389 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.885361    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-model-cache\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:24.887034 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.886999    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-dshm" (OuterVolumeSpecName: "dshm") pod "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" (UID: "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:45:24.887164 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.887078    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" (UID: "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:45:24.887164 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.887133    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-kube-api-access-xj8zn" (OuterVolumeSpecName: "kube-api-access-xj8zn") pod "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" (UID: "2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0"). InnerVolumeSpecName "kube-api-access-xj8zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:45:24.986460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.986367    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj8zn\" (UniqueName: \"kubernetes.io/projected/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-kube-api-access-xj8zn\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:24.986460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.986401    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-tls-certs\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:24.986460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.986413    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-home\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:24.986460 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:24.986422    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0-dshm\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:45:25.011780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.011749    2563 generic.go:356] "Generic (PLEG): container finished" podID="2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" containerID="40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2" exitCode=0
Jul 11 01:45:25.011943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.011792    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"
Jul 11 01:45:25.011943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.011838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4" event={"ID":"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0","Type":"ContainerDied","Data":"40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2"}
Jul 11 01:45:25.011943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.011880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4" event={"ID":"2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0","Type":"ContainerDied","Data":"fbd96a3e8409cd7548aa987932b8067269f579fa1ae4972d905616e40c8f702f"}
Jul 11 01:45:25.011943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.011898    2563 scope.go:117] "RemoveContainer" containerID="40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2"
Jul 11 01:45:25.021321 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.021304    2563 scope.go:117] "RemoveContainer" containerID="40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2"
Jul 11 01:45:25.021587 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:45:25.021570    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2\": container with ID starting with 40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2 not found: ID does not exist" containerID="40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2"
Jul 11 01:45:25.021651 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.021592    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2"} err="failed to get container status \"40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2\": rpc error: code = NotFound desc = could not find container \"40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2\": container with ID starting with 40d0c5f3d2c3b77f8c23ffe83f05a40473f78708197fd892df929c2c317904b2 not found: ID does not exist"
Jul 11 01:45:25.036045 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.036021    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"]
Jul 11 01:45:25.037842 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:25.037824    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-83b6ef8d/e2e-lifecycle-model-83b6ef8d-kserve-645c584647-f5gq4"]
Jul 11 01:45:26.055189 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:26.055154    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" path="/var/lib/kubelet/pods/2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0/volumes"
Jul 11 01:45:35.679196 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:35.679154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:46.971922 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:46.971884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:47.615693 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:47.615644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:53.384198 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:53.384158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:53.453378 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:53.453337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:56.850391 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:56.850344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:57.039901 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:57.039858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:58.199586 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:58.199552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:58.350896 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:58.350865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:59.273741 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:59.273706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:45:59.449119 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:45:59.449081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:00.896186 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:00.896150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:01.355893 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:01.355807    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:46:02.104850 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:02.104822    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:46:02.107536 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:02.107508    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:46:02.112082 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:02.112059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:46:02.114358 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:02.114330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:46:02.205587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:02.205555    2563 scope.go:117] "RemoveContainer" containerID="9cc2acb51748a1d80637976ce3410faf908da77d788c92aa697f519a1e437578"
Jul 11 01:46:07.165713 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:07.165664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:07.261111 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:07.261079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:07.821274 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:07.821239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:14.999503 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:14.999443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:15.158937 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:15.158900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:15.242781 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:15.242749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:46:15.372254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:15.372223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:25.777533 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:25.777496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:26.148388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:26.148343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:47.073152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:47.073098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:52.316190 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:52.316141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:52.986997 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:52.986961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:53.048740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:53.048707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:53.316187 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:53.316093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:53.612245 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:53.612172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:53.699285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:53.699256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:56.658623 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.658593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:56.734412 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.734382    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"]
Jul 11 01:46:56.734982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.734959    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84cfde46-491e-4ec6-bb51-3d70d37c8d4a" containerName="maas-api"
Jul 11 01:46:56.734982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.734980    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84cfde46-491e-4ec6-bb51-3d70d37c8d4a" containerName="maas-api"
Jul 11 01:46:56.735174 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.735015    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" containerName="main"
Jul 11 01:46:56.735174 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.735024    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" containerName="main"
Jul 11 01:46:56.735174 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.735138    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b5a44e1-7d35-40eb-80cf-d124ef8ef6a0" containerName="main"
Jul 11 01:46:56.735174 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.735152    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="84cfde46-491e-4ec6-bb51-3d70d37c8d4a" containerName="maas-api"
Jul 11 01:46:56.735517 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.735495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:56.738794 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.738778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.741137 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.741119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:46:56.741248 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.741121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:46:56.741969 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.741955    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-62c633-serving-cert\""
Jul 11 01:46:56.742072 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.741992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:46:56.748716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.748672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"]
Jul 11 01:46:56.817810 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.817777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:56.845779 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.845750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.845919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.845789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb7c1c0-b005-4732-a864-b777100da658-openshift-service-ca\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.845919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.845877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qk87\" (UniqueName: \"kubernetes.io/projected/fbb7c1c0-b005-4732-a864-b777100da658-kube-api-access-6qk87\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.946690 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.946605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb7c1c0-b005-4732-a864-b777100da658-openshift-service-ca\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.946907 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.946676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qk87\" (UniqueName: \"kubernetes.io/projected/fbb7c1c0-b005-4732-a864-b777100da658-kube-api-access-6qk87\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.946907 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.946743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.946907 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:46:56.946845    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-serving-cert: secret "maas-api-e2e-inf-a-62c633-serving-cert" not found
Jul 11 01:46:56.947007 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:46:56.946917    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls podName:fbb7c1c0-b005-4732-a864-b777100da658 nodeName:}" failed. No retries permitted until 2026-07-11 01:46:57.446898688 +0000 UTC m=+2456.000134581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls") pod "maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" (UID: "fbb7c1c0-b005-4732-a864-b777100da658") : secret "maas-api-e2e-inf-a-62c633-serving-cert" not found
Jul 11 01:46:56.947245 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.947226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb7c1c0-b005-4732-a864-b777100da658-openshift-service-ca\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:56.956121 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:56.956089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qk87\" (UniqueName: \"kubernetes.io/projected/fbb7c1c0-b005-4732-a864-b777100da658-kube-api-access-6qk87\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:57.201264 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:57.201179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:57.302811 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:57.302777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:57.401157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:57.401130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:46:57.451434 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:57.451345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:57.453919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:57.453885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls\") pod \"maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:57.650662 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:57.650625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:57.788786 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:57.788754    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"]
Jul 11 01:46:57.790840 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:46:57.790808    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb7c1c0_b005_4732_a864_b777100da658.slice/crio-5f94ac3f60d8ab8d276cec7e5cb0c13fac05666e594d15446c5446f8a1b0aafc WatchSource:0}: Error finding container 5f94ac3f60d8ab8d276cec7e5cb0c13fac05666e594d15446c5446f8a1b0aafc: Status 404 returned error can't find the container with id 5f94ac3f60d8ab8d276cec7e5cb0c13fac05666e594d15446c5446f8a1b0aafc
Jul 11 01:46:58.504026 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:58.503991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" event={"ID":"fbb7c1c0-b005-4732-a864-b777100da658","Type":"ContainerStarted","Data":"04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d"}
Jul 11 01:46:58.504210 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:58.504051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" event={"ID":"fbb7c1c0-b005-4732-a864-b777100da658","Type":"ContainerStarted","Data":"5f94ac3f60d8ab8d276cec7e5cb0c13fac05666e594d15446c5446f8a1b0aafc"}
Jul 11 01:46:58.504210 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:58.504079    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:46:58.522883 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:46:58.522794    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" podStartSLOduration=2.049423868 podStartE2EDuration="2.52277818s" totalImagesPullingTime="473.354312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:46:58.521600301 +0000 UTC m=+2457.074836207" watchObservedRunningTime="2026-07-11 01:46:58.52277818 +0000 UTC m=+2457.076014087"
Jul 11 01:47:01.129178 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:01.129142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:01.455977 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:01.455883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:01.793661 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:01.793573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:02.231557 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:02.231521    2563 scope.go:117] "RemoveContainer" containerID="dd418fead0b1438c4db2aae5626897d316ac5e337b040b3fdca10912133a95de"
Jul 11 01:47:02.264419 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:02.264385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:04.515982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.515951    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:47:04.710675 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.710644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:04.796520 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.796440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:04.803784 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.803753    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"]
Jul 11 01:47:04.808872 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.808850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:04.811095 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.811075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1e79cd-serving-cert\""
Jul 11 01:47:04.816024 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.816003    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"]
Jul 11 01:47:04.870695 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.870656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:04.917740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.917711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc267\" (UniqueName: \"kubernetes.io/projected/ba407a70-540d-44f9-b418-eca494f8c10c-kube-api-access-bc267\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:04.917897 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.917834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:04.917959 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:04.917935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba407a70-540d-44f9-b418-eca494f8c10c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.019432 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.019394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.019608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.019462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba407a70-540d-44f9-b418-eca494f8c10c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.019608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.019478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc267\" (UniqueName: \"kubernetes.io/projected/ba407a70-540d-44f9-b418-eca494f8c10c-kube-api-access-bc267\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.019608 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:47:05.019564    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-serving-cert: secret "maas-api-e2e-inf-b-1e79cd-serving-cert" not found
Jul 11 01:47:05.019759 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:47:05.019671    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls podName:ba407a70-540d-44f9-b418-eca494f8c10c nodeName:}" failed. No retries permitted until 2026-07-11 01:47:05.519650026 +0000 UTC m=+2464.072885913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls") pod "maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl" (UID: "ba407a70-540d-44f9-b418-eca494f8c10c") : secret "maas-api-e2e-inf-b-1e79cd-serving-cert" not found
Jul 11 01:47:05.020158 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.020138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba407a70-540d-44f9-b418-eca494f8c10c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.029253 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.029226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc267\" (UniqueName: \"kubernetes.io/projected/ba407a70-540d-44f9-b418-eca494f8c10c-kube-api-access-bc267\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.183195 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.183163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:05.385209 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.385175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:05.436878 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.436802    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:47:05.506323 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.506266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:05.523551 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.523519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.526141 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.526119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls\") pod \"maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.720746 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.720661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:05.856044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:05.856020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"]
Jul 11 01:47:05.857883 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:47:05.857853    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba407a70_540d_44f9_b418_eca494f8c10c.slice/crio-e8c62ed671ccbddf2c1c80d4cdfa7a4818f6c8c94a73992f4aca850f0665da57 WatchSource:0}: Error finding container e8c62ed671ccbddf2c1c80d4cdfa7a4818f6c8c94a73992f4aca850f0665da57: Status 404 returned error can't find the container with id e8c62ed671ccbddf2c1c80d4cdfa7a4818f6c8c94a73992f4aca850f0665da57
Jul 11 01:47:06.546005 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:06.545922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl" event={"ID":"ba407a70-540d-44f9-b418-eca494f8c10c","Type":"ContainerStarted","Data":"b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd"}
Jul 11 01:47:06.546005 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:06.545971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl" event={"ID":"ba407a70-540d-44f9-b418-eca494f8c10c","Type":"ContainerStarted","Data":"e8c62ed671ccbddf2c1c80d4cdfa7a4818f6c8c94a73992f4aca850f0665da57"}
Jul 11 01:47:06.546452 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:06.546051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:06.561976 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:06.561932    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl" podStartSLOduration=2.143516463 podStartE2EDuration="2.561918161s" totalImagesPullingTime="418.401698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:47:06.560563891 +0000 UTC m=+2465.113799809" watchObservedRunningTime="2026-07-11 01:47:06.561918161 +0000 UTC m=+2465.115154066"
Jul 11 01:47:09.181495 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:09.181463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:12.557093 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:12.557061    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:47:15.905244 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:15.905194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:17.505380 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:17.505341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:47:18.031250 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.031215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:18.130798 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.130766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:18.688409 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.688381    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"]
Jul 11 01:47:18.691979 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.691962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.695323 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.695297    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-62c633\"/\"kube-root-ca.crt\""
Jul 11 01:47:18.695426 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.695383    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-62c633\"/\"test-model-62c633-kserve-self-signed-certs\""
Jul 11 01:47:18.695484 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.695466    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-62c633\"/\"default-dockercfg-4nlsb\""
Jul 11 01:47:18.695484 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.695475    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-62c633\"/\"openshift-service-ca.crt\""
Jul 11 01:47:18.701410 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.701390    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"]
Jul 11 01:47:18.714162 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.714135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:18.748417 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.748390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9v9r\" (UniqueName: \"kubernetes.io/projected/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-kube-api-access-v9v9r\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.748516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.748440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tls-certs\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.748516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.748474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-home\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.748516 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.748508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-dshm\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.748663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.748537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-model-cache\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.748663 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.748629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tmp-dir\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850155 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tls-certs\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850155 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-home\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850418 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-dshm\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850418 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-model-cache\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850418 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tmp-dir\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850418 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9v9r\" (UniqueName: \"kubernetes.io/projected/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-kube-api-access-v9v9r\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850634 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-home\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850634 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-model-cache\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.850785 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.850715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tmp-dir\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.852507 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.852489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-dshm\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.852705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.852672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tls-certs\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:18.857547 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:18.857525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9v9r\" (UniqueName: \"kubernetes.io/projected/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-kube-api-access-v9v9r\") pod \"test-model-62c633-kserve-778b6b4447-6r6gt\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") " pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:19.002419 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:19.002344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:19.129271 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:19.129245    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"]
Jul 11 01:47:19.130061 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:47:19.130035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbde6eb7e_0caf_48f4_ad7b_3c9700517bbf.slice/crio-50a798df9c9c489ea81228a851956a7c0a43e6035fe86d85dc5a9da5af70256f WatchSource:0}: Error finding container 50a798df9c9c489ea81228a851956a7c0a43e6035fe86d85dc5a9da5af70256f: Status 404 returned error can't find the container with id 50a798df9c9c489ea81228a851956a7c0a43e6035fe86d85dc5a9da5af70256f
Jul 11 01:47:19.615262 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:19.615231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt" event={"ID":"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf","Type":"ContainerStarted","Data":"3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b"}
Jul 11 01:47:19.615445 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:19.615271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt" event={"ID":"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf","Type":"ContainerStarted","Data":"50a798df9c9c489ea81228a851956a7c0a43e6035fe86d85dc5a9da5af70256f"}
Jul 11 01:47:19.631413 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:19.631366    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt" podStartSLOduration=1.631350403 podStartE2EDuration="1.631350403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:47:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:47:19.630101015 +0000 UTC m=+2478.183336923" watchObservedRunningTime="2026-07-11 01:47:19.631350403 +0000 UTC m=+2478.184586307"
Jul 11 01:47:26.345045 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:26.345013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:26.445191 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:26.445157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:47:29.002633 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:29.002593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:29.002633 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:29.002650    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:29.015015 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:29.014983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:29.675952 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:29.675922    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:47:34.107825 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:34.107779    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:47:55.237368 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:47:55.237273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:01.412214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:01.412174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:48:17.693085 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:17.693051    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"]
Jul 11 01:48:17.717938 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:17.717909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:18.746931 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:18.746892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:18.845764 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:18.845733    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"]
Jul 11 01:48:18.849128 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:18.849112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"
Jul 11 01:48:18.851327 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:18.851308    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:48:18.856787 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:18.856336    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"]
Jul 11 01:48:18.950093 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:18.950033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14a0631-7962-44f8-b247-d8a29c9465eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq\" (UID: \"d14a0631-7962-44f8-b247-d8a29c9465eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"
Jul 11 01:48:19.050873 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.050794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14a0631-7962-44f8-b247-d8a29c9465eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq\" (UID: \"d14a0631-7962-44f8-b247-d8a29c9465eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"
Jul 11 01:48:19.051395 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.051375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14a0631-7962-44f8-b247-d8a29c9465eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq\" (UID: \"d14a0631-7962-44f8-b247-d8a29c9465eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"
Jul 11 01:48:19.161142 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.161112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"
Jul 11 01:48:19.299925 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.299899    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"]
Jul 11 01:48:19.302264 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:48:19.302206    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14a0631_7962_44f8_b247_d8a29c9465eb.slice/crio-1b0c8f9bca3a23919df235c50ce28a3a94b694ab8c07080f6f7676f8d4b1284c WatchSource:0}: Error finding container 1b0c8f9bca3a23919df235c50ce28a3a94b694ab8c07080f6f7676f8d4b1284c: Status 404 returned error can't find the container with id 1b0c8f9bca3a23919df235c50ce28a3a94b694ab8c07080f6f7676f8d4b1284c
Jul 11 01:48:19.347288 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.347255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:19.453080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.453039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:19.925968 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.925927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq" event={"ID":"d14a0631-7962-44f8-b247-d8a29c9465eb","Type":"ContainerStarted","Data":"b376bc430594c80cf0821328b49e1d1cb10268015e28e4d03df49e876e6479de"}
Jul 11 01:48:19.926357 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.925984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq" event={"ID":"d14a0631-7962-44f8-b247-d8a29c9465eb","Type":"ContainerStarted","Data":"1b0c8f9bca3a23919df235c50ce28a3a94b694ab8c07080f6f7676f8d4b1284c"}
Jul 11 01:48:19.941979 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:19.941912    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq" podStartSLOduration=1.941894808 podStartE2EDuration="1.941894808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:48:19.941346841 +0000 UTC m=+2538.494582749" watchObservedRunningTime="2026-07-11 01:48:19.941894808 +0000 UTC m=+2538.495130714"
Jul 11 01:48:20.931861 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:20.931825    2563 generic.go:356] "Generic (PLEG): container finished" podID="d14a0631-7962-44f8-b247-d8a29c9465eb" containerID="b376bc430594c80cf0821328b49e1d1cb10268015e28e4d03df49e876e6479de" exitCode=0
Jul 11 01:48:20.932236 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:20.931912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq" event={"ID":"d14a0631-7962-44f8-b247-d8a29c9465eb","Type":"ContainerDied","Data":"b376bc430594c80cf0821328b49e1d1cb10268015e28e4d03df49e876e6479de"}
Jul 11 01:48:22.008438 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.008403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:48:22.066766 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.066740    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"
Jul 11 01:48:22.179849 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.179798    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14a0631-7962-44f8-b247-d8a29c9465eb-maas-api-service-ca\") pod \"d14a0631-7962-44f8-b247-d8a29c9465eb\" (UID: \"d14a0631-7962-44f8-b247-d8a29c9465eb\") "
Jul 11 01:48:22.180211 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.180187    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d14a0631-7962-44f8-b247-d8a29c9465eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d14a0631-7962-44f8-b247-d8a29c9465eb" (UID: "d14a0631-7962-44f8-b247-d8a29c9465eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:48:22.281461 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.281367    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14a0631-7962-44f8-b247-d8a29c9465eb-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:22.944677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.944636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq" event={"ID":"d14a0631-7962-44f8-b247-d8a29c9465eb","Type":"ContainerDied","Data":"1b0c8f9bca3a23919df235c50ce28a3a94b694ab8c07080f6f7676f8d4b1284c"}
Jul 11 01:48:22.944677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.944655    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq"
Jul 11 01:48:22.944917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:22.944702    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b0c8f9bca3a23919df235c50ce28a3a94b694ab8c07080f6f7676f8d4b1284c"
Jul 11 01:48:29.203520 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.203488    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"]
Jul 11 01:48:29.204105 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.203761    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" podUID="fbb7c1c0-b005-4732-a864-b777100da658" containerName="maas-api" containerID="cri-o://04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d" gracePeriod=30
Jul 11 01:48:29.230402 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.230373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:29.510369 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.510330    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" podUID="fbb7c1c0-b005-4732-a864-b777100da658" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.52:8443/health\": dial tcp 10.132.0.52:8443: connect: connection refused"
Jul 11 01:48:29.653502 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.653476    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:48:29.747032 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.746935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb7c1c0-b005-4732-a864-b777100da658-openshift-service-ca\") pod \"fbb7c1c0-b005-4732-a864-b777100da658\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") "
Jul 11 01:48:29.747032 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.746989    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qk87\" (UniqueName: \"kubernetes.io/projected/fbb7c1c0-b005-4732-a864-b777100da658-kube-api-access-6qk87\") pod \"fbb7c1c0-b005-4732-a864-b777100da658\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") "
Jul 11 01:48:29.747260 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.747041    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls\") pod \"fbb7c1c0-b005-4732-a864-b777100da658\" (UID: \"fbb7c1c0-b005-4732-a864-b777100da658\") "
Jul 11 01:48:29.747419 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.747389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbb7c1c0-b005-4732-a864-b777100da658-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbb7c1c0-b005-4732-a864-b777100da658" (UID: "fbb7c1c0-b005-4732-a864-b777100da658"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:48:29.749285 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.749258    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbb7c1c0-b005-4732-a864-b777100da658" (UID: "fbb7c1c0-b005-4732-a864-b777100da658"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:48:29.749366 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.749320    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb7c1c0-b005-4732-a864-b777100da658-kube-api-access-6qk87" (OuterVolumeSpecName: "kube-api-access-6qk87") pod "fbb7c1c0-b005-4732-a864-b777100da658" (UID: "fbb7c1c0-b005-4732-a864-b777100da658"). InnerVolumeSpecName "kube-api-access-6qk87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:48:29.848610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.848569    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb7c1c0-b005-4732-a864-b777100da658-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:29.848610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.848601    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qk87\" (UniqueName: \"kubernetes.io/projected/fbb7c1c0-b005-4732-a864-b777100da658-kube-api-access-6qk87\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:29.848610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.848616    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb7c1c0-b005-4732-a864-b777100da658-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:29.981404 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.981366    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbb7c1c0-b005-4732-a864-b777100da658" containerID="04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d" exitCode=0
Jul 11 01:48:29.981585 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.981420    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"
Jul 11 01:48:29.981585 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.981423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" event={"ID":"fbb7c1c0-b005-4732-a864-b777100da658","Type":"ContainerDied","Data":"04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d"}
Jul 11 01:48:29.981585 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.981480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m" event={"ID":"fbb7c1c0-b005-4732-a864-b777100da658","Type":"ContainerDied","Data":"5f94ac3f60d8ab8d276cec7e5cb0c13fac05666e594d15446c5446f8a1b0aafc"}
Jul 11 01:48:29.981585 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.981503    2563 scope.go:117] "RemoveContainer" containerID="04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d"
Jul 11 01:48:29.991558 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.991542    2563 scope.go:117] "RemoveContainer" containerID="04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d"
Jul 11 01:48:29.991877 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:48:29.991858    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d\": container with ID starting with 04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d not found: ID does not exist" containerID="04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d"
Jul 11 01:48:29.991932 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:29.991888    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d"} err="failed to get container status \"04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d\": rpc error: code = NotFound desc = could not find container \"04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d\": container with ID starting with 04109d5fbfdecce6146e0964368f063c75441c9132ee68c5dc70c17704e2f22d not found: ID does not exist"
Jul 11 01:48:30.001922 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:30.001849    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"]
Jul 11 01:48:30.003879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:30.003857    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-62c633-78b5c4b958-pqw4m"]
Jul 11 01:48:30.055962 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:30.055931    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbb7c1c0-b005-4732-a864-b777100da658" path="/var/lib/kubelet/pods/fbb7c1c0-b005-4732-a864-b777100da658/volumes"
Jul 11 01:48:32.712185 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:32.712149    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt" podUID="bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" containerName="main" containerID="cri-o://3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b" gracePeriod=45
Jul 11 01:48:32.961237 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:32.961210    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:48:32.998293 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:32.998203    2563 generic.go:356] "Generic (PLEG): container finished" podID="bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" containerID="3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b" exitCode=0
Jul 11 01:48:32.998293 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:32.998236    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"
Jul 11 01:48:32.998293 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:32.998278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt" event={"ID":"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf","Type":"ContainerDied","Data":"3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b"}
Jul 11 01:48:32.998526 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:32.998318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt" event={"ID":"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf","Type":"ContainerDied","Data":"50a798df9c9c489ea81228a851956a7c0a43e6035fe86d85dc5a9da5af70256f"}
Jul 11 01:48:32.998526 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:32.998336    2563 scope.go:117] "RemoveContainer" containerID="3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b"
Jul 11 01:48:33.009130 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.009113    2563 scope.go:117] "RemoveContainer" containerID="3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b"
Jul 11 01:48:33.009391 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:48:33.009372    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b\": container with ID starting with 3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b not found: ID does not exist" containerID="3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b"
Jul 11 01:48:33.009436 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.009399    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b"} err="failed to get container status \"3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b\": rpc error: code = NotFound desc = could not find container \"3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b\": container with ID starting with 3b601b1def5b252bad426673d3c9ccb6cffbf5bacd165bd43c07d0966066ac6b not found: ID does not exist"
Jul 11 01:48:33.078991 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.078961    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-dshm\") pod \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") "
Jul 11 01:48:33.079166 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-home\") pod \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") "
Jul 11 01:48:33.079166 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079048    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-model-cache\") pod \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") "
Jul 11 01:48:33.079166 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079070    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tmp-dir\") pod \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") "
Jul 11 01:48:33.079166 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079134    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tls-certs\") pod \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") "
Jul 11 01:48:33.079387 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079190    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9v9r\" (UniqueName: \"kubernetes.io/projected/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-kube-api-access-v9v9r\") pod \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\" (UID: \"bde6eb7e-0caf-48f4-ad7b-3c9700517bbf\") "
Jul 11 01:48:33.079387 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079366    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-home" (OuterVolumeSpecName: "home") pod "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" (UID: "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:33.079476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-model-cache" (OuterVolumeSpecName: "model-cache") pod "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" (UID: "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:33.079476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" (UID: "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:33.079577 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079551    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-home\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:33.079633 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079577    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-model-cache\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:33.079633 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.079621    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tmp-dir\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:33.081310 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.081285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-dshm" (OuterVolumeSpecName: "dshm") pod "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" (UID: "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:33.081421 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.081324    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-kube-api-access-v9v9r" (OuterVolumeSpecName: "kube-api-access-v9v9r") pod "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" (UID: "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf"). InnerVolumeSpecName "kube-api-access-v9v9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:48:33.081421 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.081397    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" (UID: "bde6eb7e-0caf-48f4-ad7b-3c9700517bbf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:48:33.180278 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.180241    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-dshm\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:33.180278 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.180276    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-tls-certs\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:33.180278 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.180288    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9v9r\" (UniqueName: \"kubernetes.io/projected/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf-kube-api-access-v9v9r\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:33.320492 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.320460    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"]
Jul 11 01:48:33.324322 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.324298    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-62c633/test-model-62c633-kserve-778b6b4447-6r6gt"]
Jul 11 01:48:33.922764 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:33.922734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:34.055070 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:34.055032    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" path="/var/lib/kubelet/pods/bde6eb7e-0caf-48f4-ad7b-3c9700517bbf/volumes"
Jul 11 01:48:39.705140 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:39.705096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:39.761652 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:39.761606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:41.210381 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:41.210341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:48:44.570307 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:44.570277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:44.793580 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:44.793540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:45.456530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:45.456499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:45.561068 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:45.561032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:54.103785 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:54.103750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:54.205691 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:54.205646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:55.398624 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:55.398590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:55.501274 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:55.501240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:55.621653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:55.621621    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"]
Jul 11 01:48:55.621880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:55.621854    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl" podUID="ba407a70-540d-44f9-b418-eca494f8c10c" containerName="maas-api" containerID="cri-o://b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd" gracePeriod=30
Jul 11 01:48:55.647225 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:55.647194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:48:56.071072 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.071047    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:48:56.079380 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.079360    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc267\" (UniqueName: \"kubernetes.io/projected/ba407a70-540d-44f9-b418-eca494f8c10c-kube-api-access-bc267\") pod \"ba407a70-540d-44f9-b418-eca494f8c10c\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") "
Jul 11 01:48:56.079491 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.079428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba407a70-540d-44f9-b418-eca494f8c10c-openshift-service-ca\") pod \"ba407a70-540d-44f9-b418-eca494f8c10c\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") "
Jul 11 01:48:56.079491 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.079449    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls\") pod \"ba407a70-540d-44f9-b418-eca494f8c10c\" (UID: \"ba407a70-540d-44f9-b418-eca494f8c10c\") "
Jul 11 01:48:56.079820 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.079793    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba407a70-540d-44f9-b418-eca494f8c10c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba407a70-540d-44f9-b418-eca494f8c10c" (UID: "ba407a70-540d-44f9-b418-eca494f8c10c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:48:56.081589 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.081559    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba407a70-540d-44f9-b418-eca494f8c10c" (UID: "ba407a70-540d-44f9-b418-eca494f8c10c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:48:56.081716 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.081563    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba407a70-540d-44f9-b418-eca494f8c10c-kube-api-access-bc267" (OuterVolumeSpecName: "kube-api-access-bc267") pod "ba407a70-540d-44f9-b418-eca494f8c10c" (UID: "ba407a70-540d-44f9-b418-eca494f8c10c"). InnerVolumeSpecName "kube-api-access-bc267". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:48:56.118333 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.118298    2563 generic.go:356] "Generic (PLEG): container finished" podID="ba407a70-540d-44f9-b418-eca494f8c10c" containerID="b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd" exitCode=0
Jul 11 01:48:56.118472 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.118359    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"
Jul 11 01:48:56.118472 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.118386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl" event={"ID":"ba407a70-540d-44f9-b418-eca494f8c10c","Type":"ContainerDied","Data":"b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd"}
Jul 11 01:48:56.118472 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.118437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl" event={"ID":"ba407a70-540d-44f9-b418-eca494f8c10c","Type":"ContainerDied","Data":"e8c62ed671ccbddf2c1c80d4cdfa7a4818f6c8c94a73992f4aca850f0665da57"}
Jul 11 01:48:56.118472 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.118461    2563 scope.go:117] "RemoveContainer" containerID="b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd"
Jul 11 01:48:56.127995 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.127978    2563 scope.go:117] "RemoveContainer" containerID="b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd"
Jul 11 01:48:56.128279 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:48:56.128263    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd\": container with ID starting with b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd not found: ID does not exist" containerID="b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd"
Jul 11 01:48:56.128327 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.128288    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd"} err="failed to get container status \"b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd\": rpc error: code = NotFound desc = could not find container \"b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd\": container with ID starting with b2c3bd359724be5fe2e4dfbe37c4f45a11290feaccf60c083174737be2a164fd not found: ID does not exist"
Jul 11 01:48:56.138597 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.138571    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"]
Jul 11 01:48:56.142232 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.142208    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e79cd-7c957979c9-2blgl"]
Jul 11 01:48:56.180677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.180609    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba407a70-540d-44f9-b418-eca494f8c10c-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:56.180677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.180635    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba407a70-540d-44f9-b418-eca494f8c10c-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:56.180677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:56.180647    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc267\" (UniqueName: \"kubernetes.io/projected/ba407a70-540d-44f9-b418-eca494f8c10c-kube-api-access-bc267\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:48:58.055642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:58.055597    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba407a70-540d-44f9-b418-eca494f8c10c" path="/var/lib/kubelet/pods/ba407a70-540d-44f9-b418-eca494f8c10c/volumes"
Jul 11 01:48:59.003211 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:59.003174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:48:59.981955 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:48:59.981912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:05.789241 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:05.789189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:05.846379 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:05.846342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:10.647135 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:10.647105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:10.866926 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:10.866893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:11.211008 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:11.210966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:11.530834 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:11.530733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:11.673871 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:11.673826    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:14.268457 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.268419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:14.369509 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.369474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:14.407989 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.407956    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"]
Jul 11 01:49:14.408577 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408548    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba407a70-540d-44f9-b418-eca494f8c10c" containerName="maas-api"
Jul 11 01:49:14.408577 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408573    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba407a70-540d-44f9-b418-eca494f8c10c" containerName="maas-api"
Jul 11 01:49:14.408762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408587    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14a0631-7962-44f8-b247-d8a29c9465eb" containerName="revoke-keys"
Jul 11 01:49:14.408762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408596    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14a0631-7962-44f8-b247-d8a29c9465eb" containerName="revoke-keys"
Jul 11 01:49:14.408762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408623    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" containerName="main"
Jul 11 01:49:14.408762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408631    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" containerName="main"
Jul 11 01:49:14.408762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408646    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb7c1c0-b005-4732-a864-b777100da658" containerName="maas-api"
Jul 11 01:49:14.408762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408654    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb7c1c0-b005-4732-a864-b777100da658" containerName="maas-api"
Jul 11 01:49:14.408948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408778    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d14a0631-7962-44f8-b247-d8a29c9465eb" containerName="revoke-keys"
Jul 11 01:49:14.408948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408790    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb7c1c0-b005-4732-a864-b777100da658" containerName="maas-api"
Jul 11 01:49:14.408948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408801    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba407a70-540d-44f9-b418-eca494f8c10c" containerName="maas-api"
Jul 11 01:49:14.408948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.408811    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bde6eb7e-0caf-48f4-ad7b-3c9700517bbf" containerName="main"
Jul 11 01:49:14.411939 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.411918    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.415064 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.414951    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1e2f0c-serving-cert\""
Jul 11 01:49:14.415064 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.414988    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:49:14.415064 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.415015    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:49:14.415506 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.415490    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:49:14.421714 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.421664    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"]
Jul 11 01:49:14.467478 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.467442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:14.549888 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.549798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435a8312-0702-451b-9fc8-2845689bcb6c-maas-api-tls\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.550054 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.549956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kshc\" (UniqueName: \"kubernetes.io/projected/435a8312-0702-451b-9fc8-2845689bcb6c-kube-api-access-2kshc\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.550054 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.549991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435a8312-0702-451b-9fc8-2845689bcb6c-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.570520 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.570496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:14.651007 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.650970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kshc\" (UniqueName: \"kubernetes.io/projected/435a8312-0702-451b-9fc8-2845689bcb6c-kube-api-access-2kshc\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.651007 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.651003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435a8312-0702-451b-9fc8-2845689bcb6c-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.651259 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.651029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435a8312-0702-451b-9fc8-2845689bcb6c-maas-api-tls\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.651628 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.651605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435a8312-0702-451b-9fc8-2845689bcb6c-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.653396 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.653375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435a8312-0702-451b-9fc8-2845689bcb6c-maas-api-tls\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.664043 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.664018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kshc\" (UniqueName: \"kubernetes.io/projected/435a8312-0702-451b-9fc8-2845689bcb6c-kube-api-access-2kshc\") pod \"maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.723647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.723615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:14.859662 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.859631    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"]
Jul 11 01:49:14.860673 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:49:14.860645    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435a8312_0702_451b_9fc8_2845689bcb6c.slice/crio-9e8fc78badf947b66ec9e9d32827c9a7b9466a26928875dc12425e4b02583e82 WatchSource:0}: Error finding container 9e8fc78badf947b66ec9e9d32827c9a7b9466a26928875dc12425e4b02583e82: Status 404 returned error can't find the container with id 9e8fc78badf947b66ec9e9d32827c9a7b9466a26928875dc12425e4b02583e82
Jul 11 01:49:14.862371 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:14.862355    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:49:15.042137 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:15.042104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:15.144136 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:15.144103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:15.221823 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:15.221787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57" event={"ID":"435a8312-0702-451b-9fc8-2845689bcb6c","Type":"ContainerStarted","Data":"9e8fc78badf947b66ec9e9d32827c9a7b9466a26928875dc12425e4b02583e82"}
Jul 11 01:49:16.228501 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:16.228466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57" event={"ID":"435a8312-0702-451b-9fc8-2845689bcb6c","Type":"ContainerStarted","Data":"67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0"}
Jul 11 01:49:16.228925 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:16.228600    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:16.246800 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:16.246599    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57" podStartSLOduration=1.8071236389999998 podStartE2EDuration="2.246582396s" totalImagesPullingTime="439.458757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:49:16.246168769 +0000 UTC m=+2594.799404675" watchObservedRunningTime="2026-07-11 01:49:16.246582396 +0000 UTC m=+2594.799818301"
Jul 11 01:49:18.752811 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:18.752774    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:19.191875 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:19.191840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:19.475269 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:19.475180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:20.184980 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:20.184945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:21.619535 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:21.619501    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:49:22.240486 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.240458    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:22.312816 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.312780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:22.425653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.425616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:22.563268 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.563184    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"]
Jul 11 01:49:22.567719 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.567700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.577871 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.576604    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-124c39-serving-cert\""
Jul 11 01:49:22.582213 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.582183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"]
Jul 11 01:49:22.594767 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.594731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:22.691987 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.691951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:22.726550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.726514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68zhv\" (UniqueName: \"kubernetes.io/projected/08be574f-b369-480e-9328-b8836f97dac4-kube-api-access-68zhv\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.726756 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.726563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08be574f-b369-480e-9328-b8836f97dac4-maas-api-tls\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.726756 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.726626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08be574f-b369-480e-9328-b8836f97dac4-openshift-service-ca\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.828044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.827960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68zhv\" (UniqueName: \"kubernetes.io/projected/08be574f-b369-480e-9328-b8836f97dac4-kube-api-access-68zhv\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.828044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.827999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08be574f-b369-480e-9328-b8836f97dac4-maas-api-tls\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.828044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.828046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08be574f-b369-480e-9328-b8836f97dac4-openshift-service-ca\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.828769 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.828744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08be574f-b369-480e-9328-b8836f97dac4-openshift-service-ca\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.830522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.830501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08be574f-b369-480e-9328-b8836f97dac4-maas-api-tls\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.835804 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.835779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68zhv\" (UniqueName: \"kubernetes.io/projected/08be574f-b369-480e-9328-b8836f97dac4-kube-api-access-68zhv\") pod \"maas-api-e2e-api-b-124c39-7f564c799c-c8649\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:22.886926 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:22.886894    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:23.019533 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:23.019506    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"]
Jul 11 01:49:23.021172 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:49:23.021139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08be574f_b369_480e_9328_b8836f97dac4.slice/crio-abb83063fe21067a33ca7ee01d769ecb1bca958c77e0e401dbb3c247a4b2f588 WatchSource:0}: Error finding container abb83063fe21067a33ca7ee01d769ecb1bca958c77e0e401dbb3c247a4b2f588: Status 404 returned error can't find the container with id abb83063fe21067a33ca7ee01d769ecb1bca958c77e0e401dbb3c247a4b2f588
Jul 11 01:49:23.136038 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:23.136007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:23.237101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:23.237066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:23.265924 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:23.265894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649" event={"ID":"08be574f-b369-480e-9328-b8836f97dac4","Type":"ContainerStarted","Data":"abb83063fe21067a33ca7ee01d769ecb1bca958c77e0e401dbb3c247a4b2f588"}
Jul 11 01:49:24.273616 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:24.273570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649" event={"ID":"08be574f-b369-480e-9328-b8836f97dac4","Type":"ContainerStarted","Data":"c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f"}
Jul 11 01:49:24.274080 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:24.273699    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:24.290903 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:24.290852    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649" podStartSLOduration=1.98550604 podStartE2EDuration="2.290836872s" totalImagesPullingTime="305.330832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:49:24.288108972 +0000 UTC m=+2602.841344889" watchObservedRunningTime="2026-07-11 01:49:24.290836872 +0000 UTC m=+2602.844072777"
Jul 11 01:49:26.778214 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:26.778181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:30.285149 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:30.285119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:49:34.802951 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:34.802913    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"]
Jul 11 01:49:34.806265 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:34.806250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"
Jul 11 01:49:34.808612 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:34.808589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:49:34.811880 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:34.811857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"]
Jul 11 01:49:34.941792 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:34.941756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83420a5e-74c6-4737-a70b-f63bed7053f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq\" (UID: \"83420a5e-74c6-4737-a70b-f63bed7053f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"
Jul 11 01:49:35.042917 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:35.042873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83420a5e-74c6-4737-a70b-f63bed7053f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq\" (UID: \"83420a5e-74c6-4737-a70b-f63bed7053f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"
Jul 11 01:49:35.043521 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:35.043501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83420a5e-74c6-4737-a70b-f63bed7053f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq\" (UID: \"83420a5e-74c6-4737-a70b-f63bed7053f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"
Jul 11 01:49:35.119123 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:35.119044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"
Jul 11 01:49:35.249507 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:35.249486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"]
Jul 11 01:49:35.251450 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:49:35.251424    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83420a5e_74c6_4737_a70b_f63bed7053f1.slice/crio-26fbf30f6b254988775adfa3e40e0173ad133b2cf4979ac6332b89db6d780aa2 WatchSource:0}: Error finding container 26fbf30f6b254988775adfa3e40e0173ad133b2cf4979ac6332b89db6d780aa2: Status 404 returned error can't find the container with id 26fbf30f6b254988775adfa3e40e0173ad133b2cf4979ac6332b89db6d780aa2
Jul 11 01:49:35.332131 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:35.332098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq" event={"ID":"83420a5e-74c6-4737-a70b-f63bed7053f1","Type":"ContainerStarted","Data":"26fbf30f6b254988775adfa3e40e0173ad133b2cf4979ac6332b89db6d780aa2"}
Jul 11 01:49:35.441807 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:35.441776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:35.565313 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:35.565276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:36.339003 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:36.338915    2563 generic.go:356] "Generic (PLEG): container finished" podID="83420a5e-74c6-4737-a70b-f63bed7053f1" containerID="8ba32f1b290d8c101bd0c3ac8f2fbd858148916eda7d46dcf1dab82804162535" exitCode=0
Jul 11 01:49:36.339355 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:36.338999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq" event={"ID":"83420a5e-74c6-4737-a70b-f63bed7053f1","Type":"ContainerDied","Data":"8ba32f1b290d8c101bd0c3ac8f2fbd858148916eda7d46dcf1dab82804162535"}
Jul 11 01:49:37.484872 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:37.484847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"
Jul 11 01:49:37.563489 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:37.563443    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83420a5e-74c6-4737-a70b-f63bed7053f1-maas-api-service-ca\") pod \"83420a5e-74c6-4737-a70b-f63bed7053f1\" (UID: \"83420a5e-74c6-4737-a70b-f63bed7053f1\") "
Jul 11 01:49:37.563807 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:37.563782    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83420a5e-74c6-4737-a70b-f63bed7053f1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "83420a5e-74c6-4737-a70b-f63bed7053f1" (UID: "83420a5e-74c6-4737-a70b-f63bed7053f1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:49:37.664903 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:37.664856    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83420a5e-74c6-4737-a70b-f63bed7053f1-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:49:38.201614 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:38.201579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:49:38.351358 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:38.351273    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq"
Jul 11 01:49:38.351358 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:38.351316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq" event={"ID":"83420a5e-74c6-4737-a70b-f63bed7053f1","Type":"ContainerDied","Data":"26fbf30f6b254988775adfa3e40e0173ad133b2cf4979ac6332b89db6d780aa2"}
Jul 11 01:49:38.351538 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:38.351364    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26fbf30f6b254988775adfa3e40e0173ad133b2cf4979ac6332b89db6d780aa2"
Jul 11 01:49:43.867839 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:43.867805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:43.969131 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:43.969098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:45.369708 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.369650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:45.469647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.469614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:45.588899 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.588866    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"]
Jul 11 01:49:45.589163 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.589140    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57" podUID="435a8312-0702-451b-9fc8-2845689bcb6c" containerName="maas-api" containerID="cri-o://67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0" gracePeriod=30
Jul 11 01:49:45.617158 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.617123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:45.839186 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.839162    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:45.943610 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.943583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435a8312-0702-451b-9fc8-2845689bcb6c-maas-api-tls\") pod \"435a8312-0702-451b-9fc8-2845689bcb6c\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") "
Jul 11 01:49:45.943815 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.943618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kshc\" (UniqueName: \"kubernetes.io/projected/435a8312-0702-451b-9fc8-2845689bcb6c-kube-api-access-2kshc\") pod \"435a8312-0702-451b-9fc8-2845689bcb6c\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") "
Jul 11 01:49:45.943815 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.943748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435a8312-0702-451b-9fc8-2845689bcb6c-openshift-service-ca\") pod \"435a8312-0702-451b-9fc8-2845689bcb6c\" (UID: \"435a8312-0702-451b-9fc8-2845689bcb6c\") "
Jul 11 01:49:45.944097 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.944074    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435a8312-0702-451b-9fc8-2845689bcb6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "435a8312-0702-451b-9fc8-2845689bcb6c" (UID: "435a8312-0702-451b-9fc8-2845689bcb6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:49:45.945758 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.945737    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435a8312-0702-451b-9fc8-2845689bcb6c-kube-api-access-2kshc" (OuterVolumeSpecName: "kube-api-access-2kshc") pod "435a8312-0702-451b-9fc8-2845689bcb6c" (UID: "435a8312-0702-451b-9fc8-2845689bcb6c"). InnerVolumeSpecName "kube-api-access-2kshc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:49:45.945815 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:45.945778    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/435a8312-0702-451b-9fc8-2845689bcb6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "435a8312-0702-451b-9fc8-2845689bcb6c" (UID: "435a8312-0702-451b-9fc8-2845689bcb6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:49:46.045076 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.045003    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435a8312-0702-451b-9fc8-2845689bcb6c-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:49:46.045076 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.045028    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435a8312-0702-451b-9fc8-2845689bcb6c-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:49:46.045076 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.045036    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kshc\" (UniqueName: \"kubernetes.io/projected/435a8312-0702-451b-9fc8-2845689bcb6c-kube-api-access-2kshc\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:49:46.393267 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.393231    2563 generic.go:356] "Generic (PLEG): container finished" podID="435a8312-0702-451b-9fc8-2845689bcb6c" containerID="67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0" exitCode=0
Jul 11 01:49:46.393645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.393279    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"
Jul 11 01:49:46.393645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.393315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57" event={"ID":"435a8312-0702-451b-9fc8-2845689bcb6c","Type":"ContainerDied","Data":"67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0"}
Jul 11 01:49:46.393645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.393369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57" event={"ID":"435a8312-0702-451b-9fc8-2845689bcb6c","Type":"ContainerDied","Data":"9e8fc78badf947b66ec9e9d32827c9a7b9466a26928875dc12425e4b02583e82"}
Jul 11 01:49:46.393645 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.393392    2563 scope.go:117] "RemoveContainer" containerID="67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0"
Jul 11 01:49:46.402513 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.402496    2563 scope.go:117] "RemoveContainer" containerID="67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0"
Jul 11 01:49:46.402802 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:49:46.402779    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0\": container with ID starting with 67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0 not found: ID does not exist" containerID="67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0"
Jul 11 01:49:46.402945 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.402808    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0"} err="failed to get container status \"67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0\": rpc error: code = NotFound desc = could not find container \"67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0\": container with ID starting with 67d9daf2e8d13f36fb2f989837962b0caed137825f4390c0ee79acd5e24fcce0 not found: ID does not exist"
Jul 11 01:49:46.409060 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.409034    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"]
Jul 11 01:49:46.411018 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:46.411001    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e2f0c-5848cf479-q6d57"]
Jul 11 01:49:48.055555 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:48.055525    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="435a8312-0702-451b-9fc8-2845689bcb6c" path="/var/lib/kubelet/pods/435a8312-0702-451b-9fc8-2845689bcb6c/volumes"
Jul 11 01:49:48.110801 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:48.110766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:49:49.890841 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:49.890809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:55.604812 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:55.604764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:49:55.664127 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:49:55.664091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:00.620338 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:00.620300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:00.841445 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:00.841411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:01.482303 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:01.482273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:01.581951 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:01.581914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:11.497773 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.497744    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"]
Jul 11 01:50:11.498279 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.497978    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649" podUID="08be574f-b369-480e-9328-b8836f97dac4" containerName="maas-api" containerID="cri-o://c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f" gracePeriod=30
Jul 11 01:50:11.520775 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.520751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:11.746653 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.746630    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:50:11.881864 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.881839    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08be574f-b369-480e-9328-b8836f97dac4-maas-api-tls\") pod \"08be574f-b369-480e-9328-b8836f97dac4\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") "
Jul 11 01:50:11.882014 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.881880    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08be574f-b369-480e-9328-b8836f97dac4-openshift-service-ca\") pod \"08be574f-b369-480e-9328-b8836f97dac4\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") "
Jul 11 01:50:11.882014 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.881897    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68zhv\" (UniqueName: \"kubernetes.io/projected/08be574f-b369-480e-9328-b8836f97dac4-kube-api-access-68zhv\") pod \"08be574f-b369-480e-9328-b8836f97dac4\" (UID: \"08be574f-b369-480e-9328-b8836f97dac4\") "
Jul 11 01:50:11.882219 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.882196    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08be574f-b369-480e-9328-b8836f97dac4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08be574f-b369-480e-9328-b8836f97dac4" (UID: "08be574f-b369-480e-9328-b8836f97dac4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:50:11.883908 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.883880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08be574f-b369-480e-9328-b8836f97dac4-kube-api-access-68zhv" (OuterVolumeSpecName: "kube-api-access-68zhv") pod "08be574f-b369-480e-9328-b8836f97dac4" (UID: "08be574f-b369-480e-9328-b8836f97dac4"). InnerVolumeSpecName "kube-api-access-68zhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:50:11.883908 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.883897    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08be574f-b369-480e-9328-b8836f97dac4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08be574f-b369-480e-9328-b8836f97dac4" (UID: "08be574f-b369-480e-9328-b8836f97dac4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:50:11.982771 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.982730    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08be574f-b369-480e-9328-b8836f97dac4-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:50:11.982771 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.982766    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08be574f-b369-480e-9328-b8836f97dac4-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:50:11.982771 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:11.982779    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68zhv\" (UniqueName: \"kubernetes.io/projected/08be574f-b369-480e-9328-b8836f97dac4-kube-api-access-68zhv\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:50:12.536926 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.536887    2563 generic.go:356] "Generic (PLEG): container finished" podID="08be574f-b369-480e-9328-b8836f97dac4" containerID="c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f" exitCode=0
Jul 11 01:50:12.537342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.536932    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"
Jul 11 01:50:12.537342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.536964    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649" event={"ID":"08be574f-b369-480e-9328-b8836f97dac4","Type":"ContainerDied","Data":"c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f"}
Jul 11 01:50:12.537342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.537017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649" event={"ID":"08be574f-b369-480e-9328-b8836f97dac4","Type":"ContainerDied","Data":"abb83063fe21067a33ca7ee01d769ecb1bca958c77e0e401dbb3c247a4b2f588"}
Jul 11 01:50:12.537342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.537040    2563 scope.go:117] "RemoveContainer" containerID="c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f"
Jul 11 01:50:12.545774 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.545755    2563 scope.go:117] "RemoveContainer" containerID="c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f"
Jul 11 01:50:12.546030 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:50:12.546001    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f\": container with ID starting with c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f not found: ID does not exist" containerID="c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f"
Jul 11 01:50:12.546088 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.546032    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f"} err="failed to get container status \"c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f\": rpc error: code = NotFound desc = could not find container \"c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f\": container with ID starting with c6796c711030388b3a2de6ea04b3b813c83b76ce30bbd76f3509eadaf900fb6f not found: ID does not exist"
Jul 11 01:50:12.552106 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.552084    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"]
Jul 11 01:50:12.555665 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:12.555644    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-124c39-7f564c799c-c8649"]
Jul 11 01:50:14.055874 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:14.055833    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08be574f-b369-480e-9328-b8836f97dac4" path="/var/lib/kubelet/pods/08be574f-b369-480e-9328-b8836f97dac4/volumes"
Jul 11 01:50:14.999830 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:14.999795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:50:16.059151 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:16.059116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:21.864171 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:21.864130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:21.934178 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:21.934150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:26.753193 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:26.753159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:26.993608 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:26.993571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:27.345195 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:27.345155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:27.661557 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:27.661526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:27.789501 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:27.789468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:30.660843 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.660805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:30.743199 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.743160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:30.744293 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744274    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"]
Jul 11 01:50:30.744690 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744669    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08be574f-b369-480e-9328-b8836f97dac4" containerName="maas-api"
Jul 11 01:50:30.744733 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744698    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="08be574f-b369-480e-9328-b8836f97dac4" containerName="maas-api"
Jul 11 01:50:30.744733 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744724    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="435a8312-0702-451b-9fc8-2845689bcb6c" containerName="maas-api"
Jul 11 01:50:30.744733 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744730    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="435a8312-0702-451b-9fc8-2845689bcb6c" containerName="maas-api"
Jul 11 01:50:30.744838 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744736    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83420a5e-74c6-4737-a70b-f63bed7053f1" containerName="revoke-keys"
Jul 11 01:50:30.744838 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744742    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="83420a5e-74c6-4737-a70b-f63bed7053f1" containerName="revoke-keys"
Jul 11 01:50:30.744838 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744803    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="08be574f-b369-480e-9328-b8836f97dac4" containerName="maas-api"
Jul 11 01:50:30.744838 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744813    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="83420a5e-74c6-4737-a70b-f63bed7053f1" containerName="revoke-keys"
Jul 11 01:50:30.744838 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.744819    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="435a8312-0702-451b-9fc8-2845689bcb6c" containerName="maas-api"
Jul 11 01:50:30.749568 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.749548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.751915 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.751894    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-696ed9-serving-cert\""
Jul 11 01:50:30.752035 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.752002    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:50:30.752108 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.752047    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:50:30.752629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.752614    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:50:30.760154 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.760130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"]
Jul 11 01:50:30.816559 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.816532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:30.840044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.840015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31d99320-a5cf-40b3-b4a0-111a4285bc50-maas-api-tls\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.840152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.840069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dr6t\" (UniqueName: \"kubernetes.io/projected/31d99320-a5cf-40b3-b4a0-111a4285bc50-kube-api-access-2dr6t\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.840152 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.840134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31d99320-a5cf-40b3-b4a0-111a4285bc50-openshift-service-ca\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.941417 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.941342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31d99320-a5cf-40b3-b4a0-111a4285bc50-maas-api-tls\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.941417 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.941383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dr6t\" (UniqueName: \"kubernetes.io/projected/31d99320-a5cf-40b3-b4a0-111a4285bc50-kube-api-access-2dr6t\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.941417 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.941403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31d99320-a5cf-40b3-b4a0-111a4285bc50-openshift-service-ca\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.941982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.941964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31d99320-a5cf-40b3-b4a0-111a4285bc50-openshift-service-ca\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.943797 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.943777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31d99320-a5cf-40b3-b4a0-111a4285bc50-maas-api-tls\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.955890 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.955868    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dr6t\" (UniqueName: \"kubernetes.io/projected/31d99320-a5cf-40b3-b4a0-111a4285bc50-kube-api-access-2dr6t\") pod \"maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:30.993546 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:30.993517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:31.062967 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:31.062944    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:31.191518 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:31.191470    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"]
Jul 11 01:50:31.193437 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:50:31.193408    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d99320_a5cf_40b3_b4a0_111a4285bc50.slice/crio-b5bd4a53aa89da799066a259830353739fac1c5907ac3316a739173ddd9bd76a WatchSource:0}: Error finding container b5bd4a53aa89da799066a259830353739fac1c5907ac3316a739173ddd9bd76a: Status 404 returned error can't find the container with id b5bd4a53aa89da799066a259830353739fac1c5907ac3316a739173ddd9bd76a
Jul 11 01:50:31.326695 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:31.326667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:31.430707 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:31.430666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:31.637820 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:31.637794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s" event={"ID":"31d99320-a5cf-40b3-b4a0-111a4285bc50","Type":"ContainerStarted","Data":"b5bd4a53aa89da799066a259830353739fac1c5907ac3316a739173ddd9bd76a"}
Jul 11 01:50:32.644770 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:32.644737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s" event={"ID":"31d99320-a5cf-40b3-b4a0-111a4285bc50","Type":"ContainerStarted","Data":"04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe"}
Jul 11 01:50:32.645172 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:32.644839    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:32.664414 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:32.664364    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s" podStartSLOduration=2.26138345 podStartE2EDuration="2.664347151s" totalImagesPullingTime="402.963701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:50:32.663991634 +0000 UTC m=+2671.217227565" watchObservedRunningTime="2026-07-11 01:50:32.664347151 +0000 UTC m=+2671.217583058"
Jul 11 01:50:33.967420 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:33.967385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:35.139913 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:35.139870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:35.453204 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:35.453118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:35.754086 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:35.754005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:36.382354 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:36.382319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:36.711778 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:36.711697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:50:38.655782 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:38.655752    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:50:38.758085 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:38.758052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:38.880550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:38.880519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:39.030766 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.030666    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"]
Jul 11 01:50:39.034411 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.034388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.037329 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.037311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-98dbcb-serving-cert\""
Jul 11 01:50:39.045978 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.045956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"]
Jul 11 01:50:39.066184 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.066159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:39.121859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.121819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmcq\" (UniqueName: \"kubernetes.io/projected/214972c0-1563-4fc4-a25c-6c2dee61c84a-kube-api-access-xqmcq\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.121989 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.121893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/214972c0-1563-4fc4-a25c-6c2dee61c84a-maas-api-tls\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.121989 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.121959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/214972c0-1563-4fc4-a25c-6c2dee61c84a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.214071 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.214040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:39.223259 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.223237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmcq\" (UniqueName: \"kubernetes.io/projected/214972c0-1563-4fc4-a25c-6c2dee61c84a-kube-api-access-xqmcq\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.223341 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.223273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/214972c0-1563-4fc4-a25c-6c2dee61c84a-maas-api-tls\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.223341 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.223302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/214972c0-1563-4fc4-a25c-6c2dee61c84a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.223998 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.223975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/214972c0-1563-4fc4-a25c-6c2dee61c84a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.225540 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.225523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/214972c0-1563-4fc4-a25c-6c2dee61c84a-maas-api-tls\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.230794 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.230774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmcq\" (UniqueName: \"kubernetes.io/projected/214972c0-1563-4fc4-a25c-6c2dee61c84a-kube-api-access-xqmcq\") pod \"maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.346631 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.346553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:39.480226 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.480189    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"]
Jul 11 01:50:39.483447 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:50:39.483420    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214972c0_1563_4fc4_a25c_6c2dee61c84a.slice/crio-4a91a83afb3060c4c984aa9c77418be07369521c4f36c55d4e67773980a53223 WatchSource:0}: Error finding container 4a91a83afb3060c4c984aa9c77418be07369521c4f36c55d4e67773980a53223: Status 404 returned error can't find the container with id 4a91a83afb3060c4c984aa9c77418be07369521c4f36c55d4e67773980a53223
Jul 11 01:50:39.498289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.498258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:39.598120 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.598053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:39.680570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:39.680538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77" event={"ID":"214972c0-1563-4fc4-a25c-6c2dee61c84a","Type":"ContainerStarted","Data":"4a91a83afb3060c4c984aa9c77418be07369521c4f36c55d4e67773980a53223"}
Jul 11 01:50:40.687000 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:40.686970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77" event={"ID":"214972c0-1563-4fc4-a25c-6c2dee61c84a","Type":"ContainerStarted","Data":"b66f6c7da5cc7dee18277c46a7c6fd85382e89decfc2f219cef019faea0eecf2"}
Jul 11 01:50:40.687416 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:40.687097    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:40.705008 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:40.704964    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77" podStartSLOduration=1.362240581 podStartE2EDuration="1.704950702s" totalImagesPullingTime="342.710121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:50:40.70279714 +0000 UTC m=+2679.256033070" watchObservedRunningTime="2026-07-11 01:50:40.704950702 +0000 UTC m=+2679.258186608"
Jul 11 01:50:43.256589 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:43.256548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:46.697217 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:46.697185    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:50:47.899765 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:47.899732    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:50:53.115411 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:53.115378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:50:53.216026 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:50:53.215979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:51:00.193025 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:00.192942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:51:00.293437 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:00.293392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:51:02.141705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:02.141656    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:51:02.144063 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:02.144037    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:51:02.147847 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:02.147816    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:51:02.149780 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:02.149761    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:51:06.055023 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:06.054988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:51:09.610500 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:09.610467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:51:32.806252 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.806216    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"]
Jul 11 01:51:32.810148 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.810131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:32.812638 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.812615    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"kube-root-ca.crt\""
Jul 11 01:51:32.812799 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.812657    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"openshift-service-ca.crt\""
Jul 11 01:51:32.813670 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.813651    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"default-dockercfg-dj8dw\""
Jul 11 01:51:32.813787 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.813738    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"auth-test-model-98dbcb-kserve-self-signed-certs\""
Jul 11 01:51:32.819749 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.819728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"]
Jul 11 01:51:32.913404 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.913367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:51:32.936552 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.936526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-dshm\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:32.936705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.936574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tls-certs\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:32.936705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.936598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-home\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:32.936800 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.936713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tmp-dir\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:32.936800 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.936759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2pjl\" (UniqueName: \"kubernetes.io/projected/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-kube-api-access-l2pjl\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:32.936863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:32.936820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-model-cache\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038377 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tmp-dir\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038573 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2pjl\" (UniqueName: \"kubernetes.io/projected/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-kube-api-access-l2pjl\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038573 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-model-cache\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038573 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-dshm\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038573 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tls-certs\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038573 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-home\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038890 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tmp-dir\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038941 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-model-cache\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.038976 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.038950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-home\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.040811 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.040789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-dshm\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.041066 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.041049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tls-certs\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.045702 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.045660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2pjl\" (UniqueName: \"kubernetes.io/projected/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-kube-api-access-l2pjl\") pod \"auth-test-model-98dbcb-kserve-6676584667-lwxmb\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") " pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.120542 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.120515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:33.252243 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.252219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"]
Jul 11 01:51:33.253857 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:51:33.253822    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c7779a2_590d_4ac9_9cef_c64b69dff4dd.slice/crio-8eb002b8227cd31ccfee61ef14f9ca4beb641195b16dbdf32b5a02eb39dd16b6 WatchSource:0}: Error finding container 8eb002b8227cd31ccfee61ef14f9ca4beb641195b16dbdf32b5a02eb39dd16b6: Status 404 returned error can't find the container with id 8eb002b8227cd31ccfee61ef14f9ca4beb641195b16dbdf32b5a02eb39dd16b6
Jul 11 01:51:33.963348 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.963307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb" event={"ID":"3c7779a2-590d-4ac9-9cef-c64b69dff4dd","Type":"ContainerStarted","Data":"f3a75f0b68daf558881e5e00929c4cc369acd49e8c41fa5bcf8c22ad15dc871d"}
Jul 11 01:51:33.963751 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.963357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb" event={"ID":"3c7779a2-590d-4ac9-9cef-c64b69dff4dd","Type":"ContainerStarted","Data":"8eb002b8227cd31ccfee61ef14f9ca4beb641195b16dbdf32b5a02eb39dd16b6"}
Jul 11 01:51:33.981630 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:33.981583    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb" podStartSLOduration=1.981568726 podStartE2EDuration="1.981568726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:51:33.979048854 +0000 UTC m=+2732.532284759" watchObservedRunningTime="2026-07-11 01:51:33.981568726 +0000 UTC m=+2732.534804632"
Jul 11 01:51:36.709209 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:36.709177    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:51:43.121736 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:43.121660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:43.122187 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:43.121750    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:43.134005 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:43.133982    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:44.024595 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:44.024568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:51:55.910832 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:51:55.910796    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:52:14.701642 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:52:14.701609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:52:32.602254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:52:32.602219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:52:50.105908 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:52:50.105869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:53:08.311504 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:08.311470    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:53:26.805698 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:26.805658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:53:39.632487 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:39.632443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:53:40.508256 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:40.508221    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"]
Jul 11 01:53:40.822903 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:40.822809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:53:43.508148 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:43.508114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:53:52.945760 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:52.945720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:53:54.809742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:54.809634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:53:54.911439 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:54.911408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:53:55.528393 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.528350    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb" podUID="3c7779a2-590d-4ac9-9cef-c64b69dff4dd" containerName="main" containerID="cri-o://f3a75f0b68daf558881e5e00929c4cc369acd49e8c41fa5bcf8c22ad15dc871d" gracePeriod=45
Jul 11 01:53:55.695725 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.695668    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c7779a2-590d-4ac9-9cef-c64b69dff4dd" containerID="f3a75f0b68daf558881e5e00929c4cc369acd49e8c41fa5bcf8c22ad15dc871d" exitCode=0
Jul 11 01:53:55.695897 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.695749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb" event={"ID":"3c7779a2-590d-4ac9-9cef-c64b69dff4dd","Type":"ContainerDied","Data":"f3a75f0b68daf558881e5e00929c4cc369acd49e8c41fa5bcf8c22ad15dc871d"}
Jul 11 01:53:55.789241 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.789179    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:53:55.875079 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-dshm\") pod \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") "
Jul 11 01:53:55.875079 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875082    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tmp-dir\") pod \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") "
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2pjl\" (UniqueName: \"kubernetes.io/projected/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-kube-api-access-l2pjl\") pod \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") "
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875126    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-home\") pod \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") "
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875207    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tls-certs\") pod \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") "
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875231    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-model-cache\") pod \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\" (UID: \"3c7779a2-590d-4ac9-9cef-c64b69dff4dd\") "
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875403    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c7779a2-590d-4ac9-9cef-c64b69dff4dd" (UID: "3c7779a2-590d-4ac9-9cef-c64b69dff4dd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875412    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-home" (OuterVolumeSpecName: "home") pod "3c7779a2-590d-4ac9-9cef-c64b69dff4dd" (UID: "3c7779a2-590d-4ac9-9cef-c64b69dff4dd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875536    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tmp-dir\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.875570 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875553    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-home\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.875925 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.875600    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c7779a2-590d-4ac9-9cef-c64b69dff4dd" (UID: "3c7779a2-590d-4ac9-9cef-c64b69dff4dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.877429 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.877398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-dshm" (OuterVolumeSpecName: "dshm") pod "3c7779a2-590d-4ac9-9cef-c64b69dff4dd" (UID: "3c7779a2-590d-4ac9-9cef-c64b69dff4dd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.877548 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.877496    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c7779a2-590d-4ac9-9cef-c64b69dff4dd" (UID: "3c7779a2-590d-4ac9-9cef-c64b69dff4dd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:53:55.877548 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.877498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-kube-api-access-l2pjl" (OuterVolumeSpecName: "kube-api-access-l2pjl") pod "3c7779a2-590d-4ac9-9cef-c64b69dff4dd" (UID: "3c7779a2-590d-4ac9-9cef-c64b69dff4dd"). InnerVolumeSpecName "kube-api-access-l2pjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:53:55.976101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.976062    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-tls-certs\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.976101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.976094    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-model-cache\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.976101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.976102    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-dshm\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.976101 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:55.976110    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2pjl\" (UniqueName: \"kubernetes.io/projected/3c7779a2-590d-4ac9-9cef-c64b69dff4dd-kube-api-access-l2pjl\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:53:56.702382 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:56.702351    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"
Jul 11 01:53:56.702550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:56.702377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb" event={"ID":"3c7779a2-590d-4ac9-9cef-c64b69dff4dd","Type":"ContainerDied","Data":"8eb002b8227cd31ccfee61ef14f9ca4beb641195b16dbdf32b5a02eb39dd16b6"}
Jul 11 01:53:56.702550 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:56.702432    2563 scope.go:117] "RemoveContainer" containerID="f3a75f0b68daf558881e5e00929c4cc369acd49e8c41fa5bcf8c22ad15dc871d"
Jul 11 01:53:56.720367 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:56.720338    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"]
Jul 11 01:53:56.723881 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:56.723855    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/auth-test-model-98dbcb-kserve-6676584667-lwxmb"]
Jul 11 01:53:58.055400 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:58.055369    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7779a2-590d-4ac9-9cef-c64b69dff4dd" path="/var/lib/kubelet/pods/3c7779a2-590d-4ac9-9cef-c64b69dff4dd/volumes"
Jul 11 01:53:59.602542 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:53:59.602503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:54:09.519826 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:09.519787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:54:30.014128 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.014086    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"]
Jul 11 01:54:30.014729 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.014695    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7779a2-590d-4ac9-9cef-c64b69dff4dd" containerName="main"
Jul 11 01:54:30.014729 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.014714    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7779a2-590d-4ac9-9cef-c64b69dff4dd" containerName="main"
Jul 11 01:54:30.014870 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.014855    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7779a2-590d-4ac9-9cef-c64b69dff4dd" containerName="main"
Jul 11 01:54:30.018264 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.018246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.021391 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.021359    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"openshift-service-ca.crt\""
Jul 11 01:54:30.021563 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.021424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"sub-test-model-98dbcb-kserve-self-signed-certs\""
Jul 11 01:54:30.021563 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.021450    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"kube-root-ca.crt\""
Jul 11 01:54:30.021730 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.021589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"default-dockercfg-dj8dw\""
Jul 11 01:54:30.023429 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.023408    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"]
Jul 11 01:54:30.039319 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.039299    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:54:30.204815 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.204787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lckjr\" (UniqueName: \"kubernetes.io/projected/68bdc366-614c-47c2-be0f-1b2d8e06808c-kube-api-access-lckjr\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.204954 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.204828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-home\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.204954 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.204904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-model-cache\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.204954 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.204938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bdc366-614c-47c2-be0f-1b2d8e06808c-tls-certs\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.205072 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.204981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-tmp-dir\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.205072 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.205029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-dshm\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306321 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-dshm\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lckjr\" (UniqueName: \"kubernetes.io/projected/68bdc366-614c-47c2-be0f-1b2d8e06808c-kube-api-access-lckjr\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-home\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-model-cache\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bdc366-614c-47c2-be0f-1b2d8e06808c-tls-certs\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306473 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-tmp-dir\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306840 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-home\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306895 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-model-cache\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.306948 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.306901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-tmp-dir\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.308478 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.308456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-dshm\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.308807 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.308790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bdc366-614c-47c2-be0f-1b2d8e06808c-tls-certs\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.314575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.314550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lckjr\" (UniqueName: \"kubernetes.io/projected/68bdc366-614c-47c2-be0f-1b2d8e06808c-kube-api-access-lckjr\") pod \"sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") " pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.328269 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.328251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:30.455714 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.455665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"]
Jul 11 01:54:30.457719 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:54:30.457691    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68bdc366_614c_47c2_be0f_1b2d8e06808c.slice/crio-d99b9aefe50cb17460063f4e70d11e5e2394aa8ce83f3f51078812142b106bd8 WatchSource:0}: Error finding container d99b9aefe50cb17460063f4e70d11e5e2394aa8ce83f3f51078812142b106bd8: Status 404 returned error can't find the container with id d99b9aefe50cb17460063f4e70d11e5e2394aa8ce83f3f51078812142b106bd8
Jul 11 01:54:30.900991 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.900952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq" event={"ID":"68bdc366-614c-47c2-be0f-1b2d8e06808c","Type":"ContainerStarted","Data":"c942779796b8ab127568bb3be9b81d55ee1c516639b7fa99e552b3fcf9c7613d"}
Jul 11 01:54:30.901165 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.901000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq" event={"ID":"68bdc366-614c-47c2-be0f-1b2d8e06808c","Type":"ContainerStarted","Data":"d99b9aefe50cb17460063f4e70d11e5e2394aa8ce83f3f51078812142b106bd8"}
Jul 11 01:54:30.917931 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:30.917887    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq" podStartSLOduration=1.917873256 podStartE2EDuration="1.917873256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:54:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:54:30.91550323 +0000 UTC m=+2909.468739135" watchObservedRunningTime="2026-07-11 01:54:30.917873256 +0000 UTC m=+2909.471109198"
Jul 11 01:54:34.506982 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:34.506946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:54:40.329265 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:40.329231    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:40.329818 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:40.329281    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:40.341465 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:40.341439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:40.960655 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:40.960630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:54:50.201394 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:54:50.201366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:55:06.123406 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:06.123366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:55:06.924398 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:06.924364    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"]
Jul 11 01:55:06.978592 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:06.978552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:55:09.115063 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:09.115030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:55:09.215835 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:09.215798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:55:10.803006 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:10.802972    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:55:11.336857 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:11.336824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:55:21.944435 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:21.944393    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq" podUID="68bdc366-614c-47c2-be0f-1b2d8e06808c" containerName="main" containerID="cri-o://c942779796b8ab127568bb3be9b81d55ee1c516639b7fa99e552b3fcf9c7613d" gracePeriod=45
Jul 11 01:55:22.172035 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.172003    2563 generic.go:356] "Generic (PLEG): container finished" podID="68bdc366-614c-47c2-be0f-1b2d8e06808c" containerID="c942779796b8ab127568bb3be9b81d55ee1c516639b7fa99e552b3fcf9c7613d" exitCode=0
Jul 11 01:55:22.172192 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.172071    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq" event={"ID":"68bdc366-614c-47c2-be0f-1b2d8e06808c","Type":"ContainerDied","Data":"c942779796b8ab127568bb3be9b81d55ee1c516639b7fa99e552b3fcf9c7613d"}
Jul 11 01:55:22.196745 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.196667    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:55:22.275398 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275365    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bdc366-614c-47c2-be0f-1b2d8e06808c-tls-certs\") pod \"68bdc366-614c-47c2-be0f-1b2d8e06808c\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") "
Jul 11 01:55:22.275561 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275405    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-model-cache\") pod \"68bdc366-614c-47c2-be0f-1b2d8e06808c\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") "
Jul 11 01:55:22.275561 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275431    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-dshm\") pod \"68bdc366-614c-47c2-be0f-1b2d8e06808c\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") "
Jul 11 01:55:22.275561 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275454    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lckjr\" (UniqueName: \"kubernetes.io/projected/68bdc366-614c-47c2-be0f-1b2d8e06808c-kube-api-access-lckjr\") pod \"68bdc366-614c-47c2-be0f-1b2d8e06808c\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") "
Jul 11 01:55:22.275561 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275513    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-tmp-dir\") pod \"68bdc366-614c-47c2-be0f-1b2d8e06808c\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") "
Jul 11 01:55:22.275811 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275560    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-home\") pod \"68bdc366-614c-47c2-be0f-1b2d8e06808c\" (UID: \"68bdc366-614c-47c2-be0f-1b2d8e06808c\") "
Jul 11 01:55:22.275811 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-model-cache" (OuterVolumeSpecName: "model-cache") pod "68bdc366-614c-47c2-be0f-1b2d8e06808c" (UID: "68bdc366-614c-47c2-be0f-1b2d8e06808c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:22.275912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275865    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-home" (OuterVolumeSpecName: "home") pod "68bdc366-614c-47c2-be0f-1b2d8e06808c" (UID: "68bdc366-614c-47c2-be0f-1b2d8e06808c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:22.275912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "68bdc366-614c-47c2-be0f-1b2d8e06808c" (UID: "68bdc366-614c-47c2-be0f-1b2d8e06808c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:22.275912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.275887    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-model-cache\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:55:22.277476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.277451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-dshm" (OuterVolumeSpecName: "dshm") pod "68bdc366-614c-47c2-be0f-1b2d8e06808c" (UID: "68bdc366-614c-47c2-be0f-1b2d8e06808c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:22.278020 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.277998    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68bdc366-614c-47c2-be0f-1b2d8e06808c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "68bdc366-614c-47c2-be0f-1b2d8e06808c" (UID: "68bdc366-614c-47c2-be0f-1b2d8e06808c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:55:22.278117 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.278016    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68bdc366-614c-47c2-be0f-1b2d8e06808c-kube-api-access-lckjr" (OuterVolumeSpecName: "kube-api-access-lckjr") pod "68bdc366-614c-47c2-be0f-1b2d8e06808c" (UID: "68bdc366-614c-47c2-be0f-1b2d8e06808c"). InnerVolumeSpecName "kube-api-access-lckjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:55:22.376647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.376612    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bdc366-614c-47c2-be0f-1b2d8e06808c-tls-certs\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:55:22.376647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.376641    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-dshm\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:55:22.376647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.376650    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lckjr\" (UniqueName: \"kubernetes.io/projected/68bdc366-614c-47c2-be0f-1b2d8e06808c-kube-api-access-lckjr\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:55:22.376647 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.376658    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-tmp-dir\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:55:22.376964 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:22.376667    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68bdc366-614c-47c2-be0f-1b2d8e06808c-home\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:55:23.178177 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:23.178138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq" event={"ID":"68bdc366-614c-47c2-be0f-1b2d8e06808c","Type":"ContainerDied","Data":"d99b9aefe50cb17460063f4e70d11e5e2394aa8ce83f3f51078812142b106bd8"}
Jul 11 01:55:23.178615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:23.178182    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"
Jul 11 01:55:23.178615 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:23.178200    2563 scope.go:117] "RemoveContainer" containerID="c942779796b8ab127568bb3be9b81d55ee1c516639b7fa99e552b3fcf9c7613d"
Jul 11 01:55:23.198405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:23.198377    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"]
Jul 11 01:55:23.200248 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:23.200227    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/sub-test-model-98dbcb-kserve-689fc8c79f-nrqqq"]
Jul 11 01:55:24.055999 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:24.055961    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68bdc366-614c-47c2-be0f-1b2d8e06808c" path="/var/lib/kubelet/pods/68bdc366-614c-47c2-be0f-1b2d8e06808c/volumes"
Jul 11 01:55:28.101069 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:28.101041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:55:54.020177 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:54.020134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:55:54.119522 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:55:54.119490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:56:00.892504 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:00.892462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:56:00.994194 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:00.994156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:56:01.614595 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.614558    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"]
Jul 11 01:56:01.615225 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.615205    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68bdc366-614c-47c2-be0f-1b2d8e06808c" containerName="main"
Jul 11 01:56:01.615276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.615229    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68bdc366-614c-47c2-be0f-1b2d8e06808c" containerName="main"
Jul 11 01:56:01.615373 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.615360    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="68bdc366-614c-47c2-be0f-1b2d8e06808c" containerName="main"
Jul 11 01:56:01.618886 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.618869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.622108 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.622077    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"openshift-service-ca.crt\""
Jul 11 01:56:01.622260 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.622076    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"kube-root-ca.crt\""
Jul 11 01:56:01.622335 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.622314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"rate-test-model-98dbcb-kserve-self-signed-certs\""
Jul 11 01:56:01.622583 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.622446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"default-dockercfg-dj8dw\""
Jul 11 01:56:01.625124 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.625102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"]
Jul 11 01:56:01.643452 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.643424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:56:01.746749 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.746708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-home\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.746912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.746789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tmp-dir\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.746912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.746813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-model-cache\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.746912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.746855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lblfl\" (UniqueName: \"kubernetes.io/projected/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-kube-api-access-lblfl\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.746912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.746884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tls-certs\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.746912 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.746914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-dshm\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848235 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tls-certs\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-dshm\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-home\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tmp-dir\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-model-cache\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848405 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lblfl\" (UniqueName: \"kubernetes.io/projected/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-kube-api-access-lblfl\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848785 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tmp-dir\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848900 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-model-cache\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.848900 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.848861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-home\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.850451 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.850422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-dshm\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.850744 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.850728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tls-certs\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.856866 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.856849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lblfl\" (UniqueName: \"kubernetes.io/projected/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-kube-api-access-lblfl\") pod \"rate-test-model-98dbcb-kserve-d49bf4987-m47ck\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") " pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:01.932371 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.932345    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98dbcb\"/\"default-dockercfg-dj8dw\""
Jul 11 01:56:01.940077 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:01.940046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:02.072072 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.072048    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"]
Jul 11 01:56:02.073923 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:56:02.073888    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c7c6d58_3d28_4222_9280_4f5bcc9fe8f9.slice/crio-20902e186ebc7152878df5a3bae5eadbda8bbf7b3c96616ae5dd3f6e93131373 WatchSource:0}: Error finding container 20902e186ebc7152878df5a3bae5eadbda8bbf7b3c96616ae5dd3f6e93131373: Status 404 returned error can't find the container with id 20902e186ebc7152878df5a3bae5eadbda8bbf7b3c96616ae5dd3f6e93131373
Jul 11 01:56:02.178362 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.178330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:56:02.182097 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.182076    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:56:02.184988 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.184924    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:56:02.189629 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.189608    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:56:02.384726 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.384693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck" event={"ID":"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9","Type":"ContainerStarted","Data":"666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a"}
Jul 11 01:56:02.384858 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.384739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck" event={"ID":"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9","Type":"ContainerStarted","Data":"20902e186ebc7152878df5a3bae5eadbda8bbf7b3c96616ae5dd3f6e93131373"}
Jul 11 01:56:02.401242 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:02.401196    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck" podStartSLOduration=1.401180893 podStartE2EDuration="1.401180893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:56:02.399173795 +0000 UTC m=+3000.952409704" watchObservedRunningTime="2026-07-11 01:56:02.401180893 +0000 UTC m=+3000.954416798"
Jul 11 01:56:05.908013 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:05.907979    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:56:11.940206 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:11.940176    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:11.940736 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:11.940221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:11.952144 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:11.952117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:12.450568 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:12.450540    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:56:36.007626 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:36.007590    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:56:50.699936 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:50.699903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:56:56.084201 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:56.084083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:56:57.032975 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:57.032938    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"]
Jul 11 01:56:57.053950 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:57.053918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:56:57.955341 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:57.955307    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7371-139624520814256"]
Jul 11 01:56:57.958836 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:57.958821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:56:57.961141 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:57.961121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xgmd5\""
Jul 11 01:56:57.965539 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:57.965518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520814256"]
Jul 11 01:56:58.090622 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:58.090587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv96f\" (UniqueName: \"kubernetes.io/projected/cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d-kube-api-access-sv96f\") pod \"test-curl-7371-139624520814256\" (UID: \"cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d\") " pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:56:58.191302 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:58.191257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv96f\" (UniqueName: \"kubernetes.io/projected/cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d-kube-api-access-sv96f\") pod \"test-curl-7371-139624520814256\" (UID: \"cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d\") " pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:56:58.199195 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:58.199170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv96f\" (UniqueName: \"kubernetes.io/projected/cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d-kube-api-access-sv96f\") pod \"test-curl-7371-139624520814256\" (UID: \"cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d\") " pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:56:58.269206 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:58.269134    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:56:58.400243 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:58.400214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520814256"]
Jul 11 01:56:58.401731 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:56:58.401699    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf4cc3d2_e4cd_42eb_a7a7_4bd83ca4cc2d.slice/crio-a00165378a338cc6c59060469d7a3d8e7ff0b0bdb4e1965bcffbb5ed8e27dc21 WatchSource:0}: Error finding container a00165378a338cc6c59060469d7a3d8e7ff0b0bdb4e1965bcffbb5ed8e27dc21: Status 404 returned error can't find the container with id a00165378a338cc6c59060469d7a3d8e7ff0b0bdb4e1965bcffbb5ed8e27dc21
Jul 11 01:56:58.403104 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:58.403086    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:56:58.676326 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:58.676291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520814256" event={"ID":"cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d","Type":"ContainerStarted","Data":"a00165378a338cc6c59060469d7a3d8e7ff0b0bdb4e1965bcffbb5ed8e27dc21"}
Jul 11 01:56:59.682769 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:59.682735    2563 generic.go:356] "Generic (PLEG): container finished" podID="cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" containerID="63957c1881eef81e1b1cbdd3f2d2c96336c2d85e648a1bf25b6449f62ee3b05b" exitCode=0
Jul 11 01:56:59.683169 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:56:59.682824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520814256" event={"ID":"cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d","Type":"ContainerDied","Data":"63957c1881eef81e1b1cbdd3f2d2c96336c2d85e648a1bf25b6449f62ee3b05b"}
Jul 11 01:57:00.834575 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:00.834554    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:57:00.853130 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:00.853102    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7371-139624520814256_cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d/test-curl-7371-139624520814256/0.log"
Jul 11 01:57:00.874784 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:00.874750    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7371-139624520814256"]
Jul 11 01:57:00.878367 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:00.878342    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7371-139624520814256"]
Jul 11 01:57:00.921282 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:00.921257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv96f\" (UniqueName: \"kubernetes.io/projected/cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d-kube-api-access-sv96f\") pod \"cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d\" (UID: \"cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d\") "
Jul 11 01:57:00.923340 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:00.923319    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d-kube-api-access-sv96f" (OuterVolumeSpecName: "kube-api-access-sv96f") pod "cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" (UID: "cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d"). InnerVolumeSpecName "kube-api-access-sv96f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:01.022657 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:01.022579    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv96f\" (UniqueName: \"kubernetes.io/projected/cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d-kube-api-access-sv96f\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:01.695177 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:01.695152    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:57:01.695177 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:01.695180    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a00165378a338cc6c59060469d7a3d8e7ff0b0bdb4e1965bcffbb5ed8e27dc21"
Jul 11 01:57:01.704893 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:57:01.704865    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-139624520814256\" is forbidden: User \"system:node:ip-10-0-143-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-25.ec2.internal' and this object" podUID="cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:57:02.054377 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:57:02.054284    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-139624520814256\" is forbidden: User \"system:node:ip-10-0-143-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-25.ec2.internal' and this object" podUID="cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" pod="openshift-ingress/test-curl-7371-139624520814256"
Jul 11 01:57:02.055793 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:02.055773    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" path="/var/lib/kubelet/pods/cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d/volumes"
Jul 11 01:57:04.502926 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:04.502894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:57:12.052411 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.052357    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck" podUID="8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" containerName="main" containerID="cri-o://666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a" gracePeriod=45
Jul 11 01:57:12.288740 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.288715    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:57:12.330674 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.330600    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-dshm\") pod \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") "
Jul 11 01:57:12.330831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.330677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-model-cache\") pod \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") "
Jul 11 01:57:12.330831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.330720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tls-certs\") pod \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") "
Jul 11 01:57:12.330831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.330778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-home\") pod \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") "
Jul 11 01:57:12.330831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.330813    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lblfl\" (UniqueName: \"kubernetes.io/projected/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-kube-api-access-lblfl\") pod \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") "
Jul 11 01:57:12.330831 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.330833    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tmp-dir\") pod \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\" (UID: \"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9\") "
Jul 11 01:57:12.331106 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.330923    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" (UID: "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:12.331106 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.331050    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-home" (OuterVolumeSpecName: "home") pod "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" (UID: "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:12.331210 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.331154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" (UID: "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:12.331210 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.331159    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-model-cache\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:12.331210 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.331186    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-home\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:12.332814 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.332783    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-dshm" (OuterVolumeSpecName: "dshm") pod "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" (UID: "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:12.332931 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.332827    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" (UID: "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:57:12.332931 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.332884    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-kube-api-access-lblfl" (OuterVolumeSpecName: "kube-api-access-lblfl") pod "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" (UID: "8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9"). InnerVolumeSpecName "kube-api-access-lblfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:12.432011 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.431982    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-dshm\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:12.432011 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.432006    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tls-certs\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:12.432173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.432021    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lblfl\" (UniqueName: \"kubernetes.io/projected/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-kube-api-access-lblfl\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:12.432173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.432054    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9-tmp-dir\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:12.757031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.756996    2563 generic.go:356] "Generic (PLEG): container finished" podID="8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" containerID="666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a" exitCode=0
Jul 11 01:57:12.757031 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.757034    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"
Jul 11 01:57:12.757334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.757073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck" event={"ID":"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9","Type":"ContainerDied","Data":"666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a"}
Jul 11 01:57:12.757334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.757114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck" event={"ID":"8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9","Type":"ContainerDied","Data":"20902e186ebc7152878df5a3bae5eadbda8bbf7b3c96616ae5dd3f6e93131373"}
Jul 11 01:57:12.757334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.757133    2563 scope.go:117] "RemoveContainer" containerID="666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a"
Jul 11 01:57:12.768383 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.768366    2563 scope.go:117] "RemoveContainer" containerID="666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a"
Jul 11 01:57:12.768645 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:57:12.768626    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a\": container with ID starting with 666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a not found: ID does not exist" containerID="666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a"
Jul 11 01:57:12.768709 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.768653    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a"} err="failed to get container status \"666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a\": rpc error: code = NotFound desc = could not find container \"666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a\": container with ID starting with 666b026d7c292ac330ebb427407f1d227f94d62683dccc618620fa409b4b9f6a not found: ID does not exist"
Jul 11 01:57:12.783587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.783563    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"]
Jul 11 01:57:12.785490 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:12.785471    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-98dbcb/rate-test-model-98dbcb-kserve-d49bf4987-m47ck"]
Jul 11 01:57:14.055602 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:14.055571    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" path="/var/lib/kubelet/pods/8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9/volumes"
Jul 11 01:57:15.959668 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.959634    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"]
Jul 11 01:57:15.960254 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.960232    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" containerName="test-curl-7371-139624520814256"
Jul 11 01:57:15.960334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.960257    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" containerName="test-curl-7371-139624520814256"
Jul 11 01:57:15.960334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.960312    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" containerName="main"
Jul 11 01:57:15.960334 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.960323    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" containerName="main"
Jul 11 01:57:15.960492 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.960416    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7c6d58-3d28-4222-9280-4f5bcc9fe8f9" containerName="main"
Jul 11 01:57:15.960492 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.960431    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4cc3d2-e4cd-42eb-a7a7-4bd83ca4cc2d" containerName="test-curl-7371-139624520814256"
Jul 11 01:57:15.963620 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.963599    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"
Jul 11 01:57:15.966166 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.966151    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:57:15.969415 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:15.969396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"]
Jul 11 01:57:16.060677 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.060642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b961a5cb-b068-4b83-b403-d3a64ff53c0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7\" (UID: \"b961a5cb-b068-4b83-b403-d3a64ff53c0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"
Jul 11 01:57:16.161491 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.161457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b961a5cb-b068-4b83-b403-d3a64ff53c0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7\" (UID: \"b961a5cb-b068-4b83-b403-d3a64ff53c0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"
Jul 11 01:57:16.162094 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.162070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b961a5cb-b068-4b83-b403-d3a64ff53c0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7\" (UID: \"b961a5cb-b068-4b83-b403-d3a64ff53c0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"
Jul 11 01:57:16.275253 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.275191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"
Jul 11 01:57:16.408451 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.408426    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"]
Jul 11 01:57:16.410589 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:57:16.410563    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb961a5cb_b068_4b83_b403_d3a64ff53c0c.slice/crio-2738e83b18923a95a1e8ca9ca3fdff42260baa28696f9e1b63d9109f000b9995 WatchSource:0}: Error finding container 2738e83b18923a95a1e8ca9ca3fdff42260baa28696f9e1b63d9109f000b9995: Status 404 returned error can't find the container with id 2738e83b18923a95a1e8ca9ca3fdff42260baa28696f9e1b63d9109f000b9995
Jul 11 01:57:16.473116 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.473089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:16.573911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.573857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:16.780165 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.780130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7" event={"ID":"b961a5cb-b068-4b83-b403-d3a64ff53c0c","Type":"ContainerStarted","Data":"0f975ce30e6cd5be9a11b7044a48baaef9b86a8300ac2f9d07f98b37a8c1726f"}
Jul 11 01:57:16.780374 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.780188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7" event={"ID":"b961a5cb-b068-4b83-b403-d3a64ff53c0c","Type":"ContainerStarted","Data":"2738e83b18923a95a1e8ca9ca3fdff42260baa28696f9e1b63d9109f000b9995"}
Jul 11 01:57:16.799103 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:16.799062    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7" podStartSLOduration=1.79904785 podStartE2EDuration="1.79904785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:57:16.796049575 +0000 UTC m=+3075.349285482" watchObservedRunningTime="2026-07-11 01:57:16.79904785 +0000 UTC m=+3075.352283755"
Jul 11 01:57:17.786993 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:17.786954    2563 generic.go:356] "Generic (PLEG): container finished" podID="b961a5cb-b068-4b83-b403-d3a64ff53c0c" containerID="0f975ce30e6cd5be9a11b7044a48baaef9b86a8300ac2f9d07f98b37a8c1726f" exitCode=0
Jul 11 01:57:17.787357 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:17.787036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7" event={"ID":"b961a5cb-b068-4b83-b403-d3a64ff53c0c","Type":"ContainerDied","Data":"0f975ce30e6cd5be9a11b7044a48baaef9b86a8300ac2f9d07f98b37a8c1726f"}
Jul 11 01:57:18.923363 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:18.923339    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"
Jul 11 01:57:18.986361 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:18.986331    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b961a5cb-b068-4b83-b403-d3a64ff53c0c-maas-api-service-ca\") pod \"b961a5cb-b068-4b83-b403-d3a64ff53c0c\" (UID: \"b961a5cb-b068-4b83-b403-d3a64ff53c0c\") "
Jul 11 01:57:18.986665 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:18.986644    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b961a5cb-b068-4b83-b403-d3a64ff53c0c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b961a5cb-b068-4b83-b403-d3a64ff53c0c" (UID: "b961a5cb-b068-4b83-b403-d3a64ff53c0c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:57:19.088063 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:19.087998    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b961a5cb-b068-4b83-b403-d3a64ff53c0c-maas-api-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:19.798561 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:19.798532    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7"
Jul 11 01:57:19.798761 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:19.798565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7" event={"ID":"b961a5cb-b068-4b83-b403-d3a64ff53c0c","Type":"ContainerDied","Data":"2738e83b18923a95a1e8ca9ca3fdff42260baa28696f9e1b63d9109f000b9995"}
Jul 11 01:57:19.798761 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:19.798616    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2738e83b18923a95a1e8ca9ca3fdff42260baa28696f9e1b63d9109f000b9995"
Jul 11 01:57:26.367911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.367871    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"]
Jul 11 01:57:26.368410 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.368104    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s" podUID="31d99320-a5cf-40b3-b4a0-111a4285bc50" containerName="maas-api" containerID="cri-o://04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe" gracePeriod=30
Jul 11 01:57:26.410044 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.410008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:26.819961 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.819935    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:57:26.839055 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.839021    2563 generic.go:356] "Generic (PLEG): container finished" podID="31d99320-a5cf-40b3-b4a0-111a4285bc50" containerID="04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe" exitCode=0
Jul 11 01:57:26.839232 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.839064    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"
Jul 11 01:57:26.839455 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.839423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s" event={"ID":"31d99320-a5cf-40b3-b4a0-111a4285bc50","Type":"ContainerDied","Data":"04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe"}
Jul 11 01:57:26.839587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.839501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s" event={"ID":"31d99320-a5cf-40b3-b4a0-111a4285bc50","Type":"ContainerDied","Data":"b5bd4a53aa89da799066a259830353739fac1c5907ac3316a739173ddd9bd76a"}
Jul 11 01:57:26.839587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.839533    2563 scope.go:117] "RemoveContainer" containerID="04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe"
Jul 11 01:57:26.848495 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.848460    2563 scope.go:117] "RemoveContainer" containerID="04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe"
Jul 11 01:57:26.848774 ip-10-0-143-25 kubenswrapper[2563]: E0711 01:57:26.848746    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe\": container with ID starting with 04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe not found: ID does not exist" containerID="04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe"
Jul 11 01:57:26.848887 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.848789    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe"} err="failed to get container status \"04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe\": rpc error: code = NotFound desc = could not find container \"04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe\": container with ID starting with 04c3cce976a321f7eb4669fada1c581778603c80e3c51ac7faedf69fcfd97efe not found: ID does not exist"
Jul 11 01:57:26.960556 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.960468    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dr6t\" (UniqueName: \"kubernetes.io/projected/31d99320-a5cf-40b3-b4a0-111a4285bc50-kube-api-access-2dr6t\") pod \"31d99320-a5cf-40b3-b4a0-111a4285bc50\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") "
Jul 11 01:57:26.960556 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.960532    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31d99320-a5cf-40b3-b4a0-111a4285bc50-maas-api-tls\") pod \"31d99320-a5cf-40b3-b4a0-111a4285bc50\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") "
Jul 11 01:57:26.960824 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.960571    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31d99320-a5cf-40b3-b4a0-111a4285bc50-openshift-service-ca\") pod \"31d99320-a5cf-40b3-b4a0-111a4285bc50\" (UID: \"31d99320-a5cf-40b3-b4a0-111a4285bc50\") "
Jul 11 01:57:26.960950 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.960926    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d99320-a5cf-40b3-b4a0-111a4285bc50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31d99320-a5cf-40b3-b4a0-111a4285bc50" (UID: "31d99320-a5cf-40b3-b4a0-111a4285bc50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:57:26.962630 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.962608    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31d99320-a5cf-40b3-b4a0-111a4285bc50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31d99320-a5cf-40b3-b4a0-111a4285bc50" (UID: "31d99320-a5cf-40b3-b4a0-111a4285bc50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:57:26.962674 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:26.962647    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d99320-a5cf-40b3-b4a0-111a4285bc50-kube-api-access-2dr6t" (OuterVolumeSpecName: "kube-api-access-2dr6t") pod "31d99320-a5cf-40b3-b4a0-111a4285bc50" (UID: "31d99320-a5cf-40b3-b4a0-111a4285bc50"). InnerVolumeSpecName "kube-api-access-2dr6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:27.061587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:27.061549    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31d99320-a5cf-40b3-b4a0-111a4285bc50-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:27.061587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:27.061579    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31d99320-a5cf-40b3-b4a0-111a4285bc50-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:27.061587 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:27.061594    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dr6t\" (UniqueName: \"kubernetes.io/projected/31d99320-a5cf-40b3-b4a0-111a4285bc50-kube-api-access-2dr6t\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:27.159826 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:27.159794    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"]
Jul 11 01:57:27.173480 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:27.173447    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-696ed9-54574994d6-sqm9s"]
Jul 11 01:57:28.056051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:28.056013    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d99320-a5cf-40b3-b4a0-111a4285bc50" path="/var/lib/kubelet/pods/31d99320-a5cf-40b3-b4a0-111a4285bc50/volumes"
Jul 11 01:57:29.821599 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:29.821566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:57:31.063156 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:31.063123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:37.079846 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:37.079793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:37.145362 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:37.145332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:41.717747 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:41.717711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:41.943509 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:41.943472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:42.554402 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:42.554370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:42.654323 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:42.654282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:48.728107 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:48.728071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:48.827943 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:48.827904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:52.584287 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:52.584255    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"]
Jul 11 01:57:52.584774 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:52.584677    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77" podUID="214972c0-1563-4fc4-a25c-6c2dee61c84a" containerName="maas-api" containerID="cri-o://b66f6c7da5cc7dee18277c46a7c6fd85382e89decfc2f219cef019faea0eecf2" gracePeriod=30
Jul 11 01:57:52.609087 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:52.609051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:57:52.988319 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:52.988284    2563 generic.go:356] "Generic (PLEG): container finished" podID="214972c0-1563-4fc4-a25c-6c2dee61c84a" containerID="b66f6c7da5cc7dee18277c46a7c6fd85382e89decfc2f219cef019faea0eecf2" exitCode=0
Jul 11 01:57:52.988476 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:52.988346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77" event={"ID":"214972c0-1563-4fc4-a25c-6c2dee61c84a","Type":"ContainerDied","Data":"b66f6c7da5cc7dee18277c46a7c6fd85382e89decfc2f219cef019faea0eecf2"}
Jul 11 01:57:53.036309 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.036288    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:57:53.105772 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.105735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/214972c0-1563-4fc4-a25c-6c2dee61c84a-openshift-service-ca\") pod \"214972c0-1563-4fc4-a25c-6c2dee61c84a\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") "
Jul 11 01:57:53.105967 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.105825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/214972c0-1563-4fc4-a25c-6c2dee61c84a-maas-api-tls\") pod \"214972c0-1563-4fc4-a25c-6c2dee61c84a\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") "
Jul 11 01:57:53.105967 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.105875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqmcq\" (UniqueName: \"kubernetes.io/projected/214972c0-1563-4fc4-a25c-6c2dee61c84a-kube-api-access-xqmcq\") pod \"214972c0-1563-4fc4-a25c-6c2dee61c84a\" (UID: \"214972c0-1563-4fc4-a25c-6c2dee61c84a\") "
Jul 11 01:57:53.106120 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.106096    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/214972c0-1563-4fc4-a25c-6c2dee61c84a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "214972c0-1563-4fc4-a25c-6c2dee61c84a" (UID: "214972c0-1563-4fc4-a25c-6c2dee61c84a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:57:53.106266 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.106236    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/214972c0-1563-4fc4-a25c-6c2dee61c84a-openshift-service-ca\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:53.108035 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.108012    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/214972c0-1563-4fc4-a25c-6c2dee61c84a-kube-api-access-xqmcq" (OuterVolumeSpecName: "kube-api-access-xqmcq") pod "214972c0-1563-4fc4-a25c-6c2dee61c84a" (UID: "214972c0-1563-4fc4-a25c-6c2dee61c84a"). InnerVolumeSpecName "kube-api-access-xqmcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:53.108132 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.108100    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/214972c0-1563-4fc4-a25c-6c2dee61c84a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "214972c0-1563-4fc4-a25c-6c2dee61c84a" (UID: "214972c0-1563-4fc4-a25c-6c2dee61c84a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:57:53.207234 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.207200    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/214972c0-1563-4fc4-a25c-6c2dee61c84a-maas-api-tls\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:53.207234 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.207226    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqmcq\" (UniqueName: \"kubernetes.io/projected/214972c0-1563-4fc4-a25c-6c2dee61c84a-kube-api-access-xqmcq\") on node \"ip-10-0-143-25.ec2.internal\" DevicePath \"\""
Jul 11 01:57:53.995364 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.995331    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"
Jul 11 01:57:53.995971 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.995321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77" event={"ID":"214972c0-1563-4fc4-a25c-6c2dee61c84a","Type":"ContainerDied","Data":"4a91a83afb3060c4c984aa9c77418be07369521c4f36c55d4e67773980a53223"}
Jul 11 01:57:53.995971 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:53.995490    2563 scope.go:117] "RemoveContainer" containerID="b66f6c7da5cc7dee18277c46a7c6fd85382e89decfc2f219cef019faea0eecf2"
Jul 11 01:57:54.017443 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:54.017412    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"]
Jul 11 01:57:54.024935 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:54.024910    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-98dbcb-765b6494c6-dwp77"]
Jul 11 01:57:54.056213 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:54.056181    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="214972c0-1563-4fc4-a25c-6c2dee61c84a" path="/var/lib/kubelet/pods/214972c0-1563-4fc4-a25c-6c2dee61c84a/volumes"
Jul 11 01:57:56.013992 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:56.013964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4vfm"]
Jul 11 01:57:57.147676 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:57:57.147643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:58:02.989488 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:02.989453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:58:03.089728 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:03.089670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:58:07.789434 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:07.789385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:58:08.018985 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:08.018949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:58:13.776631 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:13.776599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-r7f7m_40168dac-aaa9-4fcb-aebc-a4e636c8d572/manager/0.log"
Jul 11 01:58:13.782391 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:13.782370    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-r7f7m_40168dac-aaa9-4fcb-aebc-a4e636c8d572/copy-manifests/0.log"
Jul 11 01:58:14.377911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:14.377883    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29728890-6q9ck_e66e2f43-4aae-46c1-85dc-1e30f1ce153d/cleanup/0.log"
Jul 11 01:58:14.691484 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:14.691404    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-d0a13ce5-bc57g_a1748fff-5c33-4d80-bf0d-25aabaefdf75/revoke-keys/0.log"
Jul 11 01:58:14.798720 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:14.798671    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-1e2f0c-7kdrq_83420a5e-74c6-4737-a70b-f63bed7053f1/revoke-keys/0.log"
Jul 11 01:58:15.010182 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:15.010096    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-5db4a968-jljhv_43f25c42-0c4d-4486-a714-de86db247562/revoke-keys/0.log"
Jul 11 01:58:15.119121 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:15.119095    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-62c633-2xnvq_d14a0631-7962-44f8-b247-d8a29c9465eb/revoke-keys/0.log"
Jul 11 01:58:15.335961 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:15.335879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-5ecad626-rrv27_7030d8d4-3029-4de3-9d7d-feeff13c844b/revoke-keys/0.log"
Jul 11 01:58:15.649511 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:15.649478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-696ed9-h6bx7_b961a5cb-b068-4b83-b403-d3a64ff53c0c/revoke-keys/0.log"
Jul 11 01:58:17.305079 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:17.305049    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fpmkx_efd3217d-a98b-4466-81c6-1df0624c2f9e/manager/0.log"
Jul 11 01:58:17.409798 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:17.409764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sz4l9_910ee2bc-6468-4435-ba54-c24d187114f6/kuadrant-console-plugin/0.log"
Jul 11 01:58:17.744692 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:17.744651    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g4vfm_dd6c43eb-9493-406f-a895-f6c8262bba0f/limitador/0.log"
Jul 11 01:58:18.406378 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:18.406343    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-2rcpm_8a537606-f43e-4302-a799-775e01bc0c6e/kube-auth-proxy/0.log"
Jul 11 01:58:19.499307 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:19.499269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-42hcv_09ae8d8b-519c-4437-8d6b-04c0a6a2557d/main/0.log"
Jul 11 01:58:19.821765 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:19.821663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-n9hsp_e68a95d9-f95d-42ce-b9f1-b166554a49b7/main/0.log"
Jul 11 01:58:23.620295 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620258    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hqjb/must-gather-7fzpg"]
Jul 11 01:58:23.620705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620636    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d99320-a5cf-40b3-b4a0-111a4285bc50" containerName="maas-api"
Jul 11 01:58:23.620705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620646    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d99320-a5cf-40b3-b4a0-111a4285bc50" containerName="maas-api"
Jul 11 01:58:23.620705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620654    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="214972c0-1563-4fc4-a25c-6c2dee61c84a" containerName="maas-api"
Jul 11 01:58:23.620705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620660    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="214972c0-1563-4fc4-a25c-6c2dee61c84a" containerName="maas-api"
Jul 11 01:58:23.620705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620674    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b961a5cb-b068-4b83-b403-d3a64ff53c0c" containerName="revoke-keys"
Jul 11 01:58:23.620705 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620693    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b961a5cb-b068-4b83-b403-d3a64ff53c0c" containerName="revoke-keys"
Jul 11 01:58:23.620911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620766    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b961a5cb-b068-4b83-b403-d3a64ff53c0c" containerName="revoke-keys"
Jul 11 01:58:23.620911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620775    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="31d99320-a5cf-40b3-b4a0-111a4285bc50" containerName="maas-api"
Jul 11 01:58:23.620911 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.620783    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="214972c0-1563-4fc4-a25c-6c2dee61c84a" containerName="maas-api"
Jul 11 01:58:23.624069 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.624053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:23.626398 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.626371    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hqjb\"/\"kube-root-ca.crt\""
Jul 11 01:58:23.626541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.626443    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hqjb\"/\"openshift-service-ca.crt\""
Jul 11 01:58:23.626541 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.626500    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6hqjb\"/\"default-dockercfg-j7bpp\""
Jul 11 01:58:23.635721 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.635673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/must-gather-7fzpg"]
Jul 11 01:58:23.639426 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.639401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:58:23.698171 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.698136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log" limit=1024
Jul 11 01:58:23.806404 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.806352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a1beb55-b4cf-49b5-9b76-52caaa9dd036-must-gather-output\") pod \"must-gather-7fzpg\" (UID: \"2a1beb55-b4cf-49b5-9b76-52caaa9dd036\") " pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:23.806604 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.806501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wklr\" (UniqueName: \"kubernetes.io/projected/2a1beb55-b4cf-49b5-9b76-52caaa9dd036-kube-api-access-8wklr\") pod \"must-gather-7fzpg\" (UID: \"2a1beb55-b4cf-49b5-9b76-52caaa9dd036\") " pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:23.907856 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.907753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wklr\" (UniqueName: \"kubernetes.io/projected/2a1beb55-b4cf-49b5-9b76-52caaa9dd036-kube-api-access-8wklr\") pod \"must-gather-7fzpg\" (UID: \"2a1beb55-b4cf-49b5-9b76-52caaa9dd036\") " pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:23.907856 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.907843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a1beb55-b4cf-49b5-9b76-52caaa9dd036-must-gather-output\") pod \"must-gather-7fzpg\" (UID: \"2a1beb55-b4cf-49b5-9b76-52caaa9dd036\") " pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:23.908131 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.908115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a1beb55-b4cf-49b5-9b76-52caaa9dd036-must-gather-output\") pod \"must-gather-7fzpg\" (UID: \"2a1beb55-b4cf-49b5-9b76-52caaa9dd036\") " pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:23.923184 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.923150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wklr\" (UniqueName: \"kubernetes.io/projected/2a1beb55-b4cf-49b5-9b76-52caaa9dd036-kube-api-access-8wklr\") pod \"must-gather-7fzpg\" (UID: \"2a1beb55-b4cf-49b5-9b76-52caaa9dd036\") " pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:23.933203 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:23.933180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/must-gather-7fzpg"
Jul 11 01:58:24.096500 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:24.096471    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/must-gather-7fzpg"]
Jul 11 01:58:24.098168 ip-10-0-143-25 kubenswrapper[2563]: W0711 01:58:24.098139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a1beb55_b4cf_49b5_9b76_52caaa9dd036.slice/crio-f4f50622604636b070567949c2d3c9a5465f37e51266bcff6cb2cec2aeec907a WatchSource:0}: Error finding container f4f50622604636b070567949c2d3c9a5465f37e51266bcff6cb2cec2aeec907a: Status 404 returned error can't find the container with id f4f50622604636b070567949c2d3c9a5465f37e51266bcff6cb2cec2aeec907a
Jul 11 01:58:24.156667 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:24.156631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/must-gather-7fzpg" event={"ID":"2a1beb55-b4cf-49b5-9b76-52caaa9dd036","Type":"ContainerStarted","Data":"f4f50622604636b070567949c2d3c9a5465f37e51266bcff6cb2cec2aeec907a"}
Jul 11 01:58:25.167096 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:25.167059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/must-gather-7fzpg" event={"ID":"2a1beb55-b4cf-49b5-9b76-52caaa9dd036","Type":"ContainerStarted","Data":"cbed89aa543bf8770893ff6309dbb914e6b1eea647ceb4152a6103ccef652114"}
Jul 11 01:58:25.167528 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:25.167107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/must-gather-7fzpg" event={"ID":"2a1beb55-b4cf-49b5-9b76-52caaa9dd036","Type":"ContainerStarted","Data":"5f532de28341c0909f48d26d7716e107ed512143b6decd2418c517a5a1b5d8d6"}
Jul 11 01:58:25.182879 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:25.182765    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hqjb/must-gather-7fzpg" podStartSLOduration=1.348395892 podStartE2EDuration="2.182744643s" totalImagesPullingTime="834.348751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:58:25.182372326 +0000 UTC m=+3143.735608349" watchObservedRunningTime="2026-07-11 01:58:25.182744643 +0000 UTC m=+3143.735980551"
Jul 11 01:58:26.591920 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:26.591887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xrbwz_3b28a717-7879-4ddb-8af2-c781fd0dab18/global-pull-secret-syncer/0.log"
Jul 11 01:58:26.650440 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:26.650406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c7glx_c8aba721-3554-4bc3-b242-0f8dde0ef77a/konnectivity-agent/0.log"
Jul 11 01:58:26.785950 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:26.785910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-25.ec2.internal_b15c5c2738510537812bfa649878a461/haproxy/0.log"
Jul 11 01:58:31.495527 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:31.495491    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fpmkx_efd3217d-a98b-4466-81c6-1df0624c2f9e/manager/0.log"
Jul 11 01:58:31.524933 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:31.524901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sz4l9_910ee2bc-6468-4435-ba54-c24d187114f6/kuadrant-console-plugin/0.log"
Jul 11 01:58:31.719452 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:31.719418    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g4vfm_dd6c43eb-9493-406f-a895-f6c8262bba0f/limitador/0.log"
Jul 11 01:58:33.317081 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.317007    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cfe935d-85b6-4945-b5a1-c806b1907083/alertmanager/0.log"
Jul 11 01:58:33.343868 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.343841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cfe935d-85b6-4945-b5a1-c806b1907083/config-reloader/0.log"
Jul 11 01:58:33.367567 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.367532    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cfe935d-85b6-4945-b5a1-c806b1907083/kube-rbac-proxy-web/0.log"
Jul 11 01:58:33.386733 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.386698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cfe935d-85b6-4945-b5a1-c806b1907083/kube-rbac-proxy/0.log"
Jul 11 01:58:33.412343 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.412308    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cfe935d-85b6-4945-b5a1-c806b1907083/kube-rbac-proxy-metric/0.log"
Jul 11 01:58:33.432935 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.432905    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cfe935d-85b6-4945-b5a1-c806b1907083/prom-label-proxy/0.log"
Jul 11 01:58:33.454006 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.453973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cfe935d-85b6-4945-b5a1-c806b1907083/init-config-reloader/0.log"
Jul 11 01:58:33.518171 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.518133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2pt4q_30c71274-6fb4-4580-a0c0-6991ca12dacf/kube-state-metrics/0.log"
Jul 11 01:58:33.539371 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.539338    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2pt4q_30c71274-6fb4-4580-a0c0-6991ca12dacf/kube-rbac-proxy-main/0.log"
Jul 11 01:58:33.559410 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.559378    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2pt4q_30c71274-6fb4-4580-a0c0-6991ca12dacf/kube-rbac-proxy-self/0.log"
Jul 11 01:58:33.744051 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.744026    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m87mv_4e2fe6bf-f878-4aae-b631-0008348c4d07/node-exporter/0.log"
Jul 11 01:58:33.766814 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.766790    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m87mv_4e2fe6bf-f878-4aae-b631-0008348c4d07/kube-rbac-proxy/0.log"
Jul 11 01:58:33.786752 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.786639    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m87mv_4e2fe6bf-f878-4aae-b631-0008348c4d07/init-textfile/0.log"
Jul 11 01:58:33.899486 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.899413    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wf8qt_d841e0b8-de13-448a-be12-b50402c1280c/kube-rbac-proxy-main/0.log"
Jul 11 01:58:33.922742 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.922715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wf8qt_d841e0b8-de13-448a-be12-b50402c1280c/kube-rbac-proxy-self/0.log"
Jul 11 01:58:33.949641 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.949607    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wf8qt_d841e0b8-de13-448a-be12-b50402c1280c/openshift-state-metrics/0.log"
Jul 11 01:58:33.998863 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:33.998836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b2d303-0961-4f01-b0e7-ec1b85f1f6de/prometheus/0.log"
Jul 11 01:58:34.029791 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.029757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b2d303-0961-4f01-b0e7-ec1b85f1f6de/config-reloader/0.log"
Jul 11 01:58:34.069815 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.069791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b2d303-0961-4f01-b0e7-ec1b85f1f6de/thanos-sidecar/0.log"
Jul 11 01:58:34.103139 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.103097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b2d303-0961-4f01-b0e7-ec1b85f1f6de/kube-rbac-proxy-web/0.log"
Jul 11 01:58:34.128530 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.128496    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b2d303-0961-4f01-b0e7-ec1b85f1f6de/kube-rbac-proxy/0.log"
Jul 11 01:58:34.154668 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.154638    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b2d303-0961-4f01-b0e7-ec1b85f1f6de/kube-rbac-proxy-thanos/0.log"
Jul 11 01:58:34.178319 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.178285    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b2d303-0961-4f01-b0e7-ec1b85f1f6de/init-config-reloader/0.log"
Jul 11 01:58:34.287384 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.287352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-745848d5bc-4jthw_c6f8d0b2-0e53-48b5-981a-0354e7dec6d2/telemeter-client/0.log"
Jul 11 01:58:34.315562 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.315484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-745848d5bc-4jthw_c6f8d0b2-0e53-48b5-981a-0354e7dec6d2/reload/0.log"
Jul 11 01:58:34.349157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:34.349126    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-745848d5bc-4jthw_c6f8d0b2-0e53-48b5-981a-0354e7dec6d2/kube-rbac-proxy/0.log"
Jul 11 01:58:35.784913 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:35.784872    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-25tfx_c687634c-5588-4dc9-abe3-44ec590658eb/networking-console-plugin/0.log"
Jul 11 01:58:36.399100 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:36.399075    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/2.log"
Jul 11 01:58:36.404995 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:36.404970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-q7gph_a93c01e8-f32f-44f5-a86f-0a8763763fb5/console-operator/3.log"
Jul 11 01:58:36.923321 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:36.923295    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d9db54d48-gdvr8_bca0a124-da9f-45c8-a37d-2f3947915a09/console/0.log"
Jul 11 01:58:36.960036 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:36.960004    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-5w7d6_3eded54b-c81a-4013-81b0-0bda0b5227e2/download-server/0.log"
Jul 11 01:58:37.196276 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.196187    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"]
Jul 11 01:58:37.203144 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.203111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.209425 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.209387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"]
Jul 11 01:58:37.255762 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.255729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-podres\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.256040 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.256024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-lib-modules\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.256157 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.256144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-sys\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.256289 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.256276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-proc\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.256402 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.256390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gnq9\" (UniqueName: \"kubernetes.io/projected/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-kube-api-access-2gnq9\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.357985 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.357948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-proc\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnq9\" (UniqueName: \"kubernetes.io/projected/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-kube-api-access-2gnq9\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-podres\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-proc\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358173 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-lib-modules\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-sys\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-podres\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358388 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-sys\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.358489 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.358412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-lib-modules\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.366564 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.366506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gnq9\" (UniqueName: \"kubernetes.io/projected/c280221f-06f7-4f06-bfd7-c68ee1ab3d6b-kube-api-access-2gnq9\") pod \"perf-node-gather-daemonset-6gm7t\" (UID: \"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.520650 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.520285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:37.692321 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:37.692282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"]
Jul 11 01:58:38.267771 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:38.267730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t" event={"ID":"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b","Type":"ContainerStarted","Data":"be9d9c0515d48dbad21bd7a5f732fa0c4813bb7d05c770541a19fa47f3c96ec7"}
Jul 11 01:58:38.268257 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:38.267803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t" event={"ID":"c280221f-06f7-4f06-bfd7-c68ee1ab3d6b","Type":"ContainerStarted","Data":"966c9d18e6505e0445439ae24f90fe3acda01aa24d6d8442d860e1eaaedca7a8"}
Jul 11 01:58:38.268257 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:38.267856    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:38.284760 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:38.284698    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t" podStartSLOduration=1.284659433 podStartE2EDuration="1.284659433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:58:38.282105513 +0000 UTC m=+3156.835341414" watchObservedRunningTime="2026-07-11 01:58:38.284659433 +0000 UTC m=+3156.837895340"
Jul 11 01:58:38.736735 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:38.736706    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vdcrx_3c8a94a0-f9a2-42d3-bab2-af5d8084a562/dns/0.log"
Jul 11 01:58:38.755816 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:38.755784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vdcrx_3c8a94a0-f9a2-42d3-bab2-af5d8084a562/kube-rbac-proxy/0.log"
Jul 11 01:58:38.821111 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:38.821085    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wd5tt_d4177f2f-ac39-4e38-8a38-6d4c0903b07b/dns-node-resolver/0.log"
Jul 11 01:58:39.345448 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:39.345422    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2zwrd_aace16b5-8518-46a8-a6fc-96756245cb15/node-ca/0.log"
Jul 11 01:58:40.419107 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:40.419073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-2rcpm_8a537606-f43e-4302-a799-775e01bc0c6e/kube-auth-proxy/0.log"
Jul 11 01:58:41.294103 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:41.294066    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5fgk_054bdd86-4a49-421e-9e4d-33f7ce248bb4/serve-healthcheck-canary/0.log"
Jul 11 01:58:41.924919 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:41.924888    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpnj5_43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c/kube-rbac-proxy/0.log"
Jul 11 01:58:41.949866 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:41.949830    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpnj5_43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c/exporter/0.log"
Jul 11 01:58:41.972268 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:41.972238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpnj5_43f5dc6d-c35d-4ccf-ab16-3c55b5757a3c/extractor/0.log"
Jul 11 01:58:44.285957 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:44.285929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-6gm7t"
Jul 11 01:58:44.532342 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:44.532311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-r7f7m_40168dac-aaa9-4fcb-aebc-a4e636c8d572/manager/0.log"
Jul 11 01:58:44.551467 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:44.551393    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-r7f7m_40168dac-aaa9-4fcb-aebc-a4e636c8d572/copy-manifests/0.log"
Jul 11 01:58:45.733585 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:45.733557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78b66d76bd-8g25k_99231ec3-1e02-4a37-bf1f-6c65ada2f258/manager/0.log"
Jul 11 01:58:47.371932 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:47.371904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-2rcpm_8a537606-f43e-4302-a799-775e01bc0c6e/kube-auth-proxy/0.log"
Jul 11 01:58:48.879966 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:48.879939    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-2rcpm_8a537606-f43e-4302-a799-775e01bc0c6e/kube-auth-proxy/0.log"
Jul 11 01:58:50.988160 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:50.988124    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pjmqz_a3628e00-1e0b-4689-8293-3046a82c83b4/migrator/0.log"
Jul 11 01:58:51.006353 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:51.006328    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pjmqz_a3628e00-1e0b-4689-8293-3046a82c83b4/graceful-termination/0.log"
Jul 11 01:58:51.360028 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:51.359938    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-ntsgr_d0b2eec6-f217-45c6-a4cc-5807f06c9599/kube-storage-version-migrator-operator/1.log"
Jul 11 01:58:51.361409 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:51.361375    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-ntsgr_d0b2eec6-f217-45c6-a4cc-5807f06c9599/kube-storage-version-migrator-operator/0.log"
Jul 11 01:58:52.471136 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.471106    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gql64_f7bda9e9-6737-4a81-8098-6a53c753a915/kube-multus-additional-cni-plugins/0.log"
Jul 11 01:58:52.489947 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.489923    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gql64_f7bda9e9-6737-4a81-8098-6a53c753a915/egress-router-binary-copy/0.log"
Jul 11 01:58:52.507860 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.507832    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gql64_f7bda9e9-6737-4a81-8098-6a53c753a915/cni-plugins/0.log"
Jul 11 01:58:52.524882 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.524853    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gql64_f7bda9e9-6737-4a81-8098-6a53c753a915/bond-cni-plugin/0.log"
Jul 11 01:58:52.542347 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.542320    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gql64_f7bda9e9-6737-4a81-8098-6a53c753a915/routeoverride-cni/0.log"
Jul 11 01:58:52.560616 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.560586    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gql64_f7bda9e9-6737-4a81-8098-6a53c753a915/whereabouts-cni-bincopy/0.log"
Jul 11 01:58:52.580178 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.580154    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gql64_f7bda9e9-6737-4a81-8098-6a53c753a915/whereabouts-cni/0.log"
Jul 11 01:58:52.823465 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.823396    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xh8rr_5600ce2f-605b-4789-92f7-d3fe51f7ffcd/kube-multus/0.log"
Jul 11 01:58:52.935859 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.935828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fd7vb_ad78a13b-e32c-49aa-887e-dee668138a07/network-metrics-daemon/0.log"
Jul 11 01:58:52.950759 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:52.950737    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fd7vb_ad78a13b-e32c-49aa-887e-dee668138a07/kube-rbac-proxy/0.log"
Jul 11 01:58:54.165612 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.165580    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-controller/0.log"
Jul 11 01:58:54.182848 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.182823    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/1.log"
Jul 11 01:58:54.183027 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.183006    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovn-acl-logging/0.log"
Jul 11 01:58:54.209779 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.209747    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/kube-rbac-proxy-node/0.log"
Jul 11 01:58:54.237646 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.237620    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/kube-rbac-proxy-ovn-metrics/0.log"
Jul 11 01:58:54.254054 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.253995    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/northd/0.log"
Jul 11 01:58:54.275383 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.275350    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/nbdb/0.log"
Jul 11 01:58:54.294837 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.294816    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/sbdb/0.log"
Jul 11 01:58:54.389302 ip-10-0-143-25 kubenswrapper[2563]: I0711 01:58:54.389267    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhfzq_0e399d95-1611-4952-aa0b-87587d7759d0/ovnkube-controller/0.log"