Jul 07 22:03:38.880535 ip-10-0-139-213 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 22:03:39.256188 ip-10-0-139-213 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 22:03:39.256188 ip-10-0-139-213 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 22:03:39.256188 ip-10-0-139-213 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 22:03:39.256188 ip-10-0-139-213 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 22:03:39.256188 ip-10-0-139-213 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 22:03:39.257829 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.257696    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 22:03:39.263248 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263232    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:03:39.263248 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263249    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263253    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263256    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263259    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263263    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263266    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263269    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263273    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263275    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263278    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263281    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263283    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263286    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263288    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263291    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263294    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263296    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263299    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263301    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263304    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:03:39.263310 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263306    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263309    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263311    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263314    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263317    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263320    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263323    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263327    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263330    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263332    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263336    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263340    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263343    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263345    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263348    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263351    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263353    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263355    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263359    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:03:39.263774 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263361    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263363    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263366    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263369    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263371    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263374    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263376    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263378    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263381    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263383    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263386    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263388    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263391    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263393    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263395    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263399    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263402    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263405    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263407    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263410    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:03:39.264252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263412    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263415    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263417    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263420    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263422    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263425    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263427    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263429    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263432    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263434    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263437    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263439    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263442    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263444    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263447    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263449    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263452    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263454    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263459    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263461    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:03:39.264782 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263464    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263466    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263469    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263471    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263474    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263476    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263478    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263483    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263485    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263488    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263491    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263494    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263497    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263500    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263502    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263505    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263509    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263512    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.263515    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:03:39.265289 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264186    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264209    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264213    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264216    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264221    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264224    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264228    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264231    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264234    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264237    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264240    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264243    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264246    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264249    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264251    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264254    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264257    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264260    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264263    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264266    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:03:39.265747 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264269    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264272    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264274    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264277    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264280    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264282    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264292    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264296    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264299    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264301    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264304    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264307    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264309    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264312    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264314    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264317    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264319    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264322    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264325    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:03:39.266252 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264327    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264330    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264332    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264335    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264338    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264341    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264343    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264346    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264349    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264351    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264354    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264356    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264358    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264361    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264366    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264369    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264371    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264374    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264376    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:03:39.266711 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264379    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264381    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264384    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264386    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264389    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264391    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264393    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264396    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264399    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264401    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264404    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264406    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264409    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264411    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264416    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264419    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264422    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264425    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264428    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264431    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:03:39.267171 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264434    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264436    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264439    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264442    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264444    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264446    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264449    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264452    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264454    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264457    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264459    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264461    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264464    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264466    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264469    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264472    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264475    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264477    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264480    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264482    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:03:39.267656 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264484    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264848    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264853    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264856    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264858    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264861    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264863    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264866    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264869    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264872    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264874    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264877    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264879    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264882    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264884    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264887    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264889    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264891    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264894    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264897    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:03:39.268135 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264899    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264902    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264904    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264907    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264909    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264912    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264915    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264918    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264920    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264922    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264925    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264927    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264930    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264933    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264935    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264937    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264940    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264942    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264946    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:03:39.268639 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264950    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264953    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264956    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264959    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264962    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264965    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264967    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264969    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264972    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264974    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264977    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264979    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264982    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264984    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264988    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264990    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264993    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264995    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.264998    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265002    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:03:39.269099 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265006    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265009    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265011    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265014    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265017    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265019    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265022    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265025    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265028    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265030    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265033    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265035    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265038    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265040    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265043    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265045    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265048    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265051    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265053    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:03:39.269631 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265057    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265060    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265064    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265066    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265069    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265072    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265074    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265076    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265079    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265082    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265084    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265086    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265089    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265092    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265094    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265097    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265099    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265101    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265104    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265107    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:03:39.270087 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265109    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265112    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265182    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265188    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265208    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265225    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265231    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265237    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265242    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265245    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265250    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265253    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265256    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265260    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265263    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265266    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265271    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265274    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265276    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265279    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265284    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265287    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265290    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265293    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 22:03:39.270582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265299    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265303    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265306    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265309    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265312    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265315    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265318    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265321    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265324    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265327    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265331    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265334    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265337    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265339    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265342    2573 flags.go:64] FLAG: --enable-server="true"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265345    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265350    2573 flags.go:64] FLAG: --event-burst="100"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265353    2573 flags.go:64] FLAG: --event-qps="50"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265356    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265360    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265363    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265366    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265369    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265372    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265376    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 07 22:03:39.271277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265379    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265382    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265385    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265388    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265390    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265393    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265396    2573 flags.go:64] FLAG: --feature-gates=""
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265401    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265404    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265407    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265410    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265413    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265416    2573 flags.go:64] FLAG: --help="false"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265419    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265421    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265424    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265427    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265430    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265433    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265436    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265438    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265441    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265444    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 22:03:39.271875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265446    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265449    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265452    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265455    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265459    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265462    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265465    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265467    2573 flags.go:64] FLAG: --lock-file=""
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265471    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265474    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265477    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265482    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265485    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265488    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265490    2573 flags.go:64] FLAG: --logging-format="text"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265493    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265498    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265501    2573 flags.go:64] FLAG: --manifest-url=""
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265504    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265509    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265511    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265515    2573 flags.go:64] FLAG: --max-pods="110"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265518    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265521    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265524    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 22:03:39.272488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265526    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265529    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265532    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265535    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265541    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265544    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265547    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265550    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265553    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265558    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265560    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265563    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265567    2573 flags.go:64] FLAG: --port="10250"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265570    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265572    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cf3e8add238b7cd9"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265575    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265579    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265582    2573 flags.go:64] FLAG: --register-node="true"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265585    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265588    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265591    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265594    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265596    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265601    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265604    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 22:03:39.273134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265607    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265610    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265612    2573 flags.go:64] FLAG: --runonce="false"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265615    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265618    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265621    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265624    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265627    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265629    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265633    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265636    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265639    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265641    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265644    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265647    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265650    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265652    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265655    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265660    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265663    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265666    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265670    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265673    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265676    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265679    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 22:03:39.273754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265682    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265684    2573 flags.go:64] FLAG: --v="2"
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265688    2573 flags.go:64] FLAG: --version="false"
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265692    2573 flags.go:64] FLAG: --vmodule=""
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265695    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.265699    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265830    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265835    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265838    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265841    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265844    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265847    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265850    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265853    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265855    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265858    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265860    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265863    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265865    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265868    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265870    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:03:39.274377 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265873    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265875    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265878    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265880    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265882    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265885    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265887    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265890    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265893    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265897    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265899    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265902    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265905    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265908    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265910    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265913    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265917    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265919    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265922    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265924    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:03:39.274887 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265927    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265929    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265932    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265934    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265937    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265939    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265941    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265944    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265946    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265949    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265951    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265954    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265956    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265958    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265961    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265963    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265967    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265971    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265975    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:03:39.275395 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265978    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265982    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265985    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265988    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265990    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265993    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265995    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.265998    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266001    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266004    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266007    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266009    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266012    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266014    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266017    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266019    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266022    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266024    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266027    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266030    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:03:39.275847 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266032    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266034    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266037    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266039    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266042    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266044    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266047    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266050    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266053    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266055    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266057    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266060    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266063    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266065    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266069    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266072    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266076    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266080    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266083    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:03:39.276355 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266085    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266088    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266092    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266095    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266097    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.266100    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.266854    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.274412    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.274427    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.275518    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.275531    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275595    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275600    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275603    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:03:39.276806 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275606    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275608    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275611    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275614    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275618    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275621    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275623    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275626    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275629    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275631    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275634    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275636    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275639    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275641    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275644    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275647    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275651    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275654    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275658    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:03:39.277153 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275662    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275665    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275667    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275670    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275672    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275675    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275677    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275681    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275684    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275686    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275689    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275692    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275694    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275697    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275699    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275702    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275704    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275707    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275709    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275712    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:03:39.277628 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275714    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275717    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275719    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275722    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275724    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275727    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275730    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275732    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275734    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275737    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275739    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275742    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275744    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275747    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275749    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275751    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275753    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275756    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275761    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275765    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:03:39.278116 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275769    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275772    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275775    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275778    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275781    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275784    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275786    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275789    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275791    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275794    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275796    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275799    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275801    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275804    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275806    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275808    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275811    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275814    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275816    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275819    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:03:39.278649 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275821    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275824    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275826    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275829    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275831    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275834    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275837    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275839    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275841    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275844    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275846    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275850    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275853    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275856    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275859    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275862    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:03:39.279140 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275864    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.275869    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275984    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275990    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275993    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275996    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.275999    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276002    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276005    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276007    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276010    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276012    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276015    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276017    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276020    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:03:39.279559 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276022    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276025    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276027    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276030    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276032    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276035    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276037    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276040    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276043    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276047    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276049    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276052    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276055    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276057    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276060    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276063    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276066    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276069    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276071    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:03:39.279931 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276074    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276076    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276079    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276081    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276084    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276086    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276088    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276091    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276093    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276096    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276098    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276100    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276103    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276105    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276108    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276110    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276112    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276115    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276117    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276120    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:03:39.280411 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276122    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276125    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276127    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276129    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276132    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276134    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276137    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276139    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276142    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276145    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276147    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276150    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276152    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276154    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276157    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276159    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276163    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276166    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276169    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276171    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:03:39.280890 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276174    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276176    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276179    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276181    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276183    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276186    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276188    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276191    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276208    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276212    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276215    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276218    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276220    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276223    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276225    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276228    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276230    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276233    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276236    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:03:39.281390 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276238    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276241    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276243    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276248    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276252    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276254    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276257    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:39.276260    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.276265    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.276378    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 22:03:39.281883 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.280216    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 22:03:39.282123 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.282084    2573 server.go:1019] "Starting client certificate rotation"
Jul 07 22:03:39.282211 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.282180    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 22:03:39.282247 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.282229    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 22:03:39.285643 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.285624    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 22:03:39.286795 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.286770    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 22:03:39.295379 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.295362    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 07 22:03:39.299109 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.299091    2573 log.go:25] "Validated CRI v1 image API"
Jul 07 22:03:39.299878 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.299863    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 22:03:39.301895 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.301876    2573 fs.go:135] Filesystem UUIDs: map[0f49273c-69ef-4ee9-b580-a5f992d8ec73:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8d38a19b-479b-4848-8623-875bcc947e9e:/dev/nvme0n1p4]
Jul 07 22:03:39.301952 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.301896    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 22:03:39.306799 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.306694    2573 manager.go:216] Machine: {Timestamp:2026-07-07 22:03:39.30545935 +0000 UTC m=+0.315398519 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099634 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25223a6aa313553685f3d8e15db693 SystemUUID:ec25223a-6aa3-1355-3685-f3d8e15db693 BootID:505c1ff3-6a04-4d70-baeb-1ea6716334f1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:43:00:25:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:43:00:25:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:2a:bd:28:e4:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 22:03:39.306799 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.306797    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 22:03:39.306901 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.306872    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 22:03:39.308467 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.308434    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 22:03:39.308608 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.308471    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 22:03:39.309892 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.309879    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 22:03:39.309926 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.309896    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 22:03:39.309926 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.309904    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 22:03:39.310506 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.310496    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 22:03:39.311484 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.311474    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 22:03:39.311777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.311763    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 22:03:39.314031 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314019    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 22:03:39.314181 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314172    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 22:03:39.314231 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314215    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 22:03:39.314231 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314225    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 22:03:39.314283 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314238    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 22:03:39.314283 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314247    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 07 22:03:39.314283 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314255    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 22:03:39.314630 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314615    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 22:03:39.314700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.314634    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 22:03:39.318400 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.318380    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 22:03:39.320023 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.320007    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 22:03:39.320103 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.320046    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 22:03:39.321022 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321004    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321027    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321034    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321039    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321048    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321053    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321061    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321066    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321072    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321078    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 22:03:39.321086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321086    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 22:03:39.321366 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321091    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 22:03:39.321714 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321705    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 22:03:39.321743 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.321715    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 22:03:39.323675 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.323650    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 22:03:39.323727 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.323685    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 22:03:39.324932 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.324921    2573 server.go:1268] "Started kubelet"
Jul 07 22:03:39.324973 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.324932    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 22:03:39.325019 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.324990    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 22:03:39.325098 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.325054    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 22:03:39.325152 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.325126    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 22:03:39.325739 ip-10-0-139-213 systemd[1]: Started Kubernetes Kubelet.
Jul 07 22:03:39.325924 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.325911    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 22:03:39.326746 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.326704    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 22:03:39.330636 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.330618    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l6xzj"
Jul 07 22:03:39.331345 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.331328    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 22:03:39.331618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.331601    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 22:03:39.331618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.331613    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 22:03:39.331762 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.331729    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:39.332325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332308    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 22:03:39.332325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332308    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 22:03:39.332470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332336    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 22:03:39.332470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332416    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 22:03:39.332470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332426    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 22:03:39.332470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332448    2573 factory.go:55] Registering systemd factory
Jul 07 22:03:39.332470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332464    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 07 22:03:39.332662 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332649    2573 factory.go:153] Registering CRI-O factory
Jul 07 22:03:39.332704 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332664    2573 factory.go:223] Registration of the crio container factory successfully
Jul 07 22:03:39.332738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332709    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 22:03:39.332738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332729    2573 factory.go:103] Registering Raw factory
Jul 07 22:03:39.332789 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.332741    2573 manager.go:1196] Started watching for new ooms in manager
Jul 07 22:03:39.333145 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.333134    2573 manager.go:349] Starting recovery of all containers
Jul 07 22:03:39.336343 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.336319    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 22:03:39.336343 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.336323    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 22:03:39.340573 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.340546    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l6xzj"
Jul 07 22:03:39.340778 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.336463    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-213.ec2.internal.18c021135355257e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-213.ec2.internal,UID:ip-10-0-139-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-213.ec2.internal,},FirstTimestamp:2026-07-07 22:03:39.324900734 +0000 UTC m=+0.334839903,LastTimestamp:2026-07-07 22:03:39.324900734 +0000 UTC m=+0.334839903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-213.ec2.internal,}"
Jul 07 22:03:39.347574 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.347456    2573 manager.go:354] Recovery completed
Jul 07 22:03:39.351605 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.351592    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:03:39.353385 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.353371    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:03:39.353454 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.353402    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:03:39.353454 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.353417    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:03:39.353979 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.353964    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 22:03:39.353979 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.353978    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 22:03:39.354073 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.353994    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 22:03:39.354073 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.353975    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:03:39.354761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.354745    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:03:39.354841 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.354775    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:03:39.354841 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.354790    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:03:39.355289 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.355272    2573 policy_none.go:49] "None policy: Start"
Jul 07 22:03:39.355367 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.355293    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 22:03:39.355367 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.355310    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 22:03:39.355431 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.355321    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-213.ec2.internal.18c021135507cc7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-213.ec2.internal,UID:ip-10-0-139-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-213.ec2.internal,},FirstTimestamp:2026-07-07 22:03:39.353386109 +0000 UTC m=+0.363325282,LastTimestamp:2026-07-07 22:03:39.353386109 +0000 UTC m=+0.363325282,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-213.ec2.internal,}"
Jul 07 22:03:39.356516 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.356503    2573 policy_none.go:47] "Start"
Jul 07 22:03:39.394357 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.394344    2573 manager.go:337] "Starting Device Plugin manager"
Jul 07 22:03:39.394441 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.394383    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 22:03:39.394441 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.394393    2573 server.go:87] "Starting device plugin registration server"
Jul 07 22:03:39.394654 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.394643    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 22:03:39.394694 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.394658    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 22:03:39.394905 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.394759    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 22:03:39.394905 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.394839    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 22:03:39.394905 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.394847    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 22:03:39.395978 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.395960    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 22:03:39.396060 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.396003    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:39.495005 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.494980    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:03:39.496001 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.495605    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 22:03:39.496417 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.496396    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:03:39.496493 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.496439    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:03:39.496493 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.496458    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:03:39.496570 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.496494    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.497181 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.497147    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 22:03:39.497326 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.497210    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 22:03:39.497326 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.497237    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 22:03:39.497326 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.497274    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 22:03:39.499118 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.499048    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:03:39.504241 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.504225    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.504323 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.504248    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-213.ec2.internal\": node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:39.558796 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.558719    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:39.597871 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.597840    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal"]
Jul 07 22:03:39.597968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.597919    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:03:39.599540 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.599521    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:03:39.599661 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.599555    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:03:39.599661 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.599570    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:03:39.600774 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.600757    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:03:39.600874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.600865    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.600935 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.600887    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:03:39.601585 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.601557    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:03:39.601585 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.601566    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:03:39.601585 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.601583    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:03:39.601796 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.601585    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:03:39.601796 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.601600    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:03:39.601796 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.601605    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:03:39.602794 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.602778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.602875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.602802    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:03:39.603466 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.603449    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:03:39.603548 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.603476    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:03:39.603548 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.603485    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:03:39.618748 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.618723    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-213.ec2.internal\" not found" node="ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.622881 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.622856    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-213.ec2.internal\" not found" node="ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.634744 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.634728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ac5ef4d7f01d69323447b7871b88f1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal\" (UID: \"5ac5ef4d7f01d69323447b7871b88f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.634826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.634753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ac5ef4d7f01d69323447b7871b88f1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal\" (UID: \"5ac5ef4d7f01d69323447b7871b88f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.634826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.634769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a83507c3630b4c4defb443358b1b6c0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-213.ec2.internal\" (UID: \"2a83507c3630b4c4defb443358b1b6c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.659263 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.659237    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:39.734921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.734879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a83507c3630b4c4defb443358b1b6c0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-213.ec2.internal\" (UID: \"2a83507c3630b4c4defb443358b1b6c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.734921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.734923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ac5ef4d7f01d69323447b7871b88f1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal\" (UID: \"5ac5ef4d7f01d69323447b7871b88f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.735136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.734965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ac5ef4d7f01d69323447b7871b88f1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal\" (UID: \"5ac5ef4d7f01d69323447b7871b88f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.735136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.734971    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ac5ef4d7f01d69323447b7871b88f1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal\" (UID: \"5ac5ef4d7f01d69323447b7871b88f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.735136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.734998    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ac5ef4d7f01d69323447b7871b88f1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal\" (UID: \"5ac5ef4d7f01d69323447b7871b88f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.735136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.735039    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a83507c3630b4c4defb443358b1b6c0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-213.ec2.internal\" (UID: \"2a83507c3630b4c4defb443358b1b6c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.760028 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.759999    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:39.860849 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.860777    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:39.920930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.920903    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.925950 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:39.925926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:39.960901 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:39.960870    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:40.061496 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:40.061449    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:40.163007 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:40.162956    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:40.263854 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:40.263823    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-213.ec2.internal\" not found"
Jul 07 22:03:40.281297 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.281267    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 22:03:40.281423 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.281407    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 22:03:40.343362 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.343298    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 21:58:40 +0000 UTC" deadline="2027-12-23 23:27:28.079229855 +0000 UTC"
Jul 07 22:03:40.343362 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.343330    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12817h23m47.735904377s"
Jul 07 22:03:40.344850 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.344823    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:03:40.433027 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.432956    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:40.442484 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.442461    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 22:03:40.444528 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.444508    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal"
Jul 07 22:03:40.456089 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:40.456052    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a83507c3630b4c4defb443358b1b6c0.slice/crio-103e1107706b11b5fc2b971fe4ec599cf0c6400891122141d0af1459105f7f84 WatchSource:0}: Error finding container 103e1107706b11b5fc2b971fe4ec599cf0c6400891122141d0af1459105f7f84: Status 404 returned error can't find the container with id 103e1107706b11b5fc2b971fe4ec599cf0c6400891122141d0af1459105f7f84
Jul 07 22:03:40.456354 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:40.456331    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac5ef4d7f01d69323447b7871b88f1d.slice/crio-7750c046cd082b0782506458d31694c75adbbccd2727bc2f998c0893c4bebd5a WatchSource:0}: Error finding container 7750c046cd082b0782506458d31694c75adbbccd2727bc2f998c0893c4bebd5a: Status 404 returned error can't find the container with id 7750c046cd082b0782506458d31694c75adbbccd2727bc2f998c0893c4bebd5a
Jul 07 22:03:40.458402 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.458380    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 22:03:40.460896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.460872    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:03:40.500731 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.500675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal" event={"ID":"5ac5ef4d7f01d69323447b7871b88f1d","Type":"ContainerStarted","Data":"7750c046cd082b0782506458d31694c75adbbccd2727bc2f998c0893c4bebd5a"}
Jul 07 22:03:40.501733 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.501708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal" event={"ID":"2a83507c3630b4c4defb443358b1b6c0","Type":"ContainerStarted","Data":"103e1107706b11b5fc2b971fe4ec599cf0c6400891122141d0af1459105f7f84"}
Jul 07 22:03:40.624882 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.624846    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:03:40.836750 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:40.836712    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:03:41.099754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.098601    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:03:41.315375 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.315341    2573 apiserver.go:52] "Watching apiserver"
Jul 07 22:03:41.321190 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.321161    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 22:03:41.323555 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.323509    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-zm7dd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj","openshift-dns/node-resolver-st2hx","openshift-multus/multus-additional-cni-plugins-pqtm2","openshift-multus/multus-qm8br","openshift-network-operator/iptables-alerter-p2n7p","openshift-ovn-kubernetes/ovnkube-node-q9qk8","kube-system/global-pull-secret-syncer-vp95t","kube-system/konnectivity-agent-7nskk","kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qk9s6","openshift-image-registry/node-ca-chd6x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal","openshift-multus/network-metrics-daemon-jvdtr"]
Jul 07 22:03:41.325463 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.325436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.327023 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.326995    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.327823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.327802    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 22:03:41.328072 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.328056    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.328378 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.328353    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 22:03:41.328490 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.328408    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 22:03:41.328490 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.328447    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 22:03:41.328659 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.328640    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 22:03:41.328741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.328688    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 22:03:41.328853 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.328838    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mzcd6\""
Jul 07 22:03:41.329199 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.329178    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.333407    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.333467    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.333635    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.333703    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.333721    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x7r65\""
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.333894    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.333993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.334025    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kspkn\""
Jul 07 22:03:41.334212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.334128    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 22:03:41.336314 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.336278    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.336703 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.336677    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:41.336810 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.336777    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:41.337889 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.337854    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.338881 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.338860    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 22:03:41.339000 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.338948    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nvcvm\""
Jul 07 22:03:41.339000 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.338958    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 22:03:41.339000 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.338968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 22:03:41.339318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.339297    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 22:03:41.339503 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.339480    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 22:03:41.339808 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.339762    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w5wtv\""
Jul 07 22:03:41.340016 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.339998    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 22:03:41.340146 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.340124    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 22:03:41.340205 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.340157    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 22:03:41.340254 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.340206    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:03:41.340358 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.340139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.340358 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.340161    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 22:03:41.340358 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.340305    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c9wvd\""
Jul 07 22:03:41.340490 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.340361    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:41.340991 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.340971    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 22:03:41.341093 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.341062    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 22:03:41.342090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.341701    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 22:03:41.342090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.341893    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 22:03:41.342090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.342028    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ncx4t\""
Jul 07 22:03:41.342454 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.342422    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-647l9\""
Jul 07 22:03:41.343733 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.343713    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:41.343854 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.343783    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:41.344742 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.344722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-env-overrides\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.344878 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.344859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-system-cni-dir\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.344970 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.344939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-daemon-config\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345030 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.344967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.345030 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.344992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-run\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.345030 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmd6\" (UniqueName: \"kubernetes.io/projected/b936e126-2515-4cdc-8812-9804616fea0b-kube-api-access-smmd6\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.345186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-run-netns\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.345186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-systemd\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.345186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345090    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.345186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-cni-netd\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.345186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-system-cni-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-netns\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-kubelet\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd-konnectivity-ca\") pod \"konnectivity-agent-7nskk\" (UID: \"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd\") " pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345219    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-var-lib-kubelet\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3792c4b-b141-4d31-883d-f52d5d2244b6-cni-binary-copy\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-cni-multus\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-hostroot\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-ovn\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-cni-bin\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b838030-5954-453f-864a-fd2cfefd9bc5-iptables-alerter-script\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-lib-modules\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-cni-bin\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cnibin\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.345551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b838030-5954-453f-864a-fd2cfefd9bc5-host-slash\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-systemd\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-etc-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovnkube-script-lib\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c3ab11d-324d-413c-b281-5ccef1f98d5e-hosts-file\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3ab11d-324d-413c-b281-5ccef1f98d5e-tmp-dir\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b936e126-2515-4cdc-8812-9804616fea0b-tmp\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.345935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-var-lib-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-node-log\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-cni-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346080    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-multus-certs\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b936e126-2515-4cdc-8812-9804616fea0b-etc-tuned\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-etc-kubernetes\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.346161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysctl-d\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysctl-conf\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rhxf\" (UniqueName: \"kubernetes.io/projected/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-kube-api-access-6rhxf\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-socket-dir-parent\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74n2t\" (UniqueName: \"kubernetes.io/projected/a3792c4b-b141-4d31-883d-f52d5d2244b6-kube-api-access-74n2t\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-sys\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovnkube-config\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq97s\" (UniqueName: \"kubernetes.io/projected/2c3ab11d-324d-413c-b281-5ccef1f98d5e-kube-api-access-tq97s\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-os-release\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-k8s-cni-cncf-io\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-kubernetes\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsz9t\" (UniqueName: \"kubernetes.io/projected/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-kube-api-access-vsz9t\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-conf-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysconfig\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.346848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-os-release\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346672    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-modprobe-d\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-kubelet\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovn-node-metrics-cert\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-host\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-systemd-units\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-log-socket\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-cnibin\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346937    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd-agent-certs\") pod \"konnectivity-agent-7nskk\" (UID: \"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd\") " pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.346964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-slash\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.347006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmrn9\" (UniqueName: \"kubernetes.io/projected/6b838030-5954-453f-864a-fd2cfefd9bc5-kube-api-access-dmrn9\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.347434    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.347435    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 22:03:41.347676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.347526    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 22:03:41.348467 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.347695    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r4vcl\""
Jul 07 22:03:41.350681 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.350402    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 22:03:41.372249 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.372222    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2mbg"
Jul 07 22:03:41.378689 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.378657    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2mbg"
Jul 07 22:03:41.433531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.433507    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 22:03:41.447434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-socket-dir-parent\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.447434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74n2t\" (UniqueName: \"kubernetes.io/projected/a3792c4b-b141-4d31-883d-f52d5d2244b6-kube-api-access-74n2t\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0173042e-1df4-4045-a58a-eec59e695ab4-serviceca\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-sys\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovnkube-config\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447544    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-socket-dir-parent\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447560    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-sys\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq97s\" (UniqueName: \"kubernetes.io/projected/2c3ab11d-324d-413c-b281-5ccef1f98d5e-kube-api-access-tq97s\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-os-release\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.447667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447654    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-k8s-cni-cncf-io\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447688    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-k8s-cni-cncf-io\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-os-release\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447801    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-kubernetes\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsz9t\" (UniqueName: \"kubernetes.io/projected/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-kube-api-access-vsz9t\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-conf-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysconfig\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447963    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-conf-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-os-release\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448004    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysconfig\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-modprobe-d\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448027    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-os-release\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-kubelet\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovn-node-metrics-cert\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448072    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.447963    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-kubernetes\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-modprobe-d\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448122    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-kubelet\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-sys-fs\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-host\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-systemd-units\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448238    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovnkube-config\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448274    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-log-socket\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448301    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-host\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448315    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-systemd-units\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448320    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-log-socket\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-cnibin\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448410    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-cnibin\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45732897-8b95-499a-ba59-0fa7dd838e43-dbus\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.448998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448482    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448505    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd-agent-certs\") pod \"konnectivity-agent-7nskk\" (UID: \"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd\") " pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-slash\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmrn9\" (UniqueName: \"kubernetes.io/projected/6b838030-5954-453f-864a-fd2cfefd9bc5-kube-api-access-dmrn9\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448664    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-slash\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-registration-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448688    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-env-overrides\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-system-cni-dir\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-daemon-config\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448871    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-system-cni-dir\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfx96\" (UniqueName: \"kubernetes.io/projected/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-kube-api-access-wfx96\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-run\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448924    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448961    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smmd6\" (UniqueName: \"kubernetes.io/projected/b936e126-2515-4cdc-8812-9804616fea0b-kube-api-access-smmd6\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.449947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448997    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-run\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449137    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-env-overrides\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449393    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-daemon-config\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.448988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-run-netns\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-systemd\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449574    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-cni-netd\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-system-cni-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-netns\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449133    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-run-netns\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-kubelet\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd-konnectivity-ca\") pod \"konnectivity-agent-7nskk\" (UID: \"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd\") " pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-var-lib-kubelet\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449686    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-systemd\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3792c4b-b141-4d31-883d-f52d5d2244b6-cni-binary-copy\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-cni-multus\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-hostroot\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449782    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-netns\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-socket-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.450708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449906    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-var-lib-kubelet\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45732897-8b95-499a-ba59-0fa7dd838e43-kubelet-config\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449967    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-system-cni-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450010    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-cni-netd\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.449737    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-kubelet\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-ovn\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-cni-bin\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b838030-5954-453f-864a-fd2cfefd9bc5-iptables-alerter-script\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-lib-modules\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-cni-bin\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cnibin\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b838030-5954-453f-864a-fd2cfefd9bc5-host-slash\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-device-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.450896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0173042e-1df4-4045-a58a-eec59e695ab4-host\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.451579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fxmt\" (UniqueName: \"kubernetes.io/projected/0173042e-1df4-4045-a58a-eec59e695ab4-kube-api-access-5fxmt\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-systemd\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-etc-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovnkube-script-lib\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c3ab11d-324d-413c-b281-5ccef1f98d5e-hosts-file\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451455    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3ab11d-324d-413c-b281-5ccef1f98d5e-tmp-dir\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b936e126-2515-4cdc-8812-9804616fea0b-tmp\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-var-lib-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451555    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-node-log\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-cni-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-multus-certs\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.451848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56kcw\" (UniqueName: \"kubernetes.io/projected/01672869-3bc8-4041-a07b-824e31672388-kube-api-access-56kcw\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.452047    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.452080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b936e126-2515-4cdc-8812-9804616fea0b-etc-tuned\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.452109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-etc-kubernetes\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.452141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysctl-d\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.452419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.452171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysctl-conf\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.453117 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.452204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rhxf\" (UniqueName: \"kubernetes.io/projected/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-kube-api-access-6rhxf\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.453117 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.452947    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3792c4b-b141-4d31-883d-f52d5d2244b6-cni-binary-copy\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.453234 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.453214    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd-konnectivity-ca\") pod \"konnectivity-agent-7nskk\" (UID: \"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd\") " pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.453336 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.453317    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-hostroot\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.453452 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.453438    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-cni-multus\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.453512 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.453493    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-run-ovn\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.453680 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.453652    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.453776 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.453715    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-var-lib-cni-bin\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.454228 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454203    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b838030-5954-453f-864a-fd2cfefd9bc5-iptables-alerter-script\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.454377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454358    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-lib-modules\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.454441 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454421    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b838030-5954-453f-864a-fd2cfefd9bc5-host-slash\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.454543 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454526    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-host-cni-bin\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.454644 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454588    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cnibin\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.454724 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454706    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-multus-cni-dir\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.454859 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454766    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.454859 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.454776    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-systemd\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.455057 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.455040    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3ab11d-324d-413c-b281-5ccef1f98d5e-tmp-dir\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.455166 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.455147    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-etc-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.455944 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.455911    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovnkube-script-lib\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.456038 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.456016    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c3ab11d-324d-413c-b281-5ccef1f98d5e-hosts-file\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.457136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.456384    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-var-lib-openvswitch\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.457136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.456454    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-node-log\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.457136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.456709    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd-agent-certs\") pod \"konnectivity-agent-7nskk\" (UID: \"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd\") " pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.457136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.457017    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-host-run-multus-certs\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.457522 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.457499    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3792c4b-b141-4d31-883d-f52d5d2244b6-etc-kubernetes\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.457765 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.457605    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b936e126-2515-4cdc-8812-9804616fea0b-tmp\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.457765 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.457731    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysctl-d\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.457885 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.457850    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b936e126-2515-4cdc-8812-9804616fea0b-etc-sysctl-conf\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.460163 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.460139    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b936e126-2515-4cdc-8812-9804616fea0b-etc-tuned\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.461488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.461416    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-ovn-node-metrics-cert\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.463034 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.463007    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq97s\" (UniqueName: \"kubernetes.io/projected/2c3ab11d-324d-413c-b281-5ccef1f98d5e-kube-api-access-tq97s\") pod \"node-resolver-st2hx\" (UID: \"2c3ab11d-324d-413c-b281-5ccef1f98d5e\") " pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.464010 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.463984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74n2t\" (UniqueName: \"kubernetes.io/projected/a3792c4b-b141-4d31-883d-f52d5d2244b6-kube-api-access-74n2t\") pod \"multus-qm8br\" (UID: \"a3792c4b-b141-4d31-883d-f52d5d2244b6\") " pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.464146 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.463994    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmrn9\" (UniqueName: \"kubernetes.io/projected/6b838030-5954-453f-864a-fd2cfefd9bc5-kube-api-access-dmrn9\") pod \"iptables-alerter-p2n7p\" (UID: \"6b838030-5954-453f-864a-fd2cfefd9bc5\") " pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.464364 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.464322    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsz9t\" (UniqueName: \"kubernetes.io/projected/556ac2bb-399c-4b5d-9ced-fc45a4a2ab08-kube-api-access-vsz9t\") pod \"multus-additional-cni-plugins-pqtm2\" (UID: \"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08\") " pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.465707 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.465688    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmd6\" (UniqueName: \"kubernetes.io/projected/b936e126-2515-4cdc-8812-9804616fea0b-kube-api-access-smmd6\") pod \"tuned-qk9s6\" (UID: \"b936e126-2515-4cdc-8812-9804616fea0b\") " pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.466389 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.466367    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rhxf\" (UniqueName: \"kubernetes.io/projected/2407265e-b9c0-44bd-9cf8-7dad898eb0e8-kube-api-access-6rhxf\") pod \"ovnkube-node-q9qk8\" (UID: \"2407265e-b9c0-44bd-9cf8-7dad898eb0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.552990 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.552956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-socket-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45732897-8b95-499a-ba59-0fa7dd838e43-kubelet-config\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-device-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0173042e-1df4-4045-a58a-eec59e695ab4-host\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fxmt\" (UniqueName: \"kubernetes.io/projected/0173042e-1df4-4045-a58a-eec59e695ab4-kube-api-access-5fxmt\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56kcw\" (UniqueName: \"kubernetes.io/projected/01672869-3bc8-4041-a07b-824e31672388-kube-api-access-56kcw\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553122    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45732897-8b95-499a-ba59-0fa7dd838e43-kubelet-config\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553168    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0173042e-1df4-4045-a58a-eec59e695ab4-host\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.553180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553174    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-socket-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553234    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553257    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0173042e-1df4-4045-a58a-eec59e695ab4-serviceca\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553299    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-device-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-sys-fs\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.553395    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45732897-8b95-499a-ba59-0fa7dd838e43-dbus\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553435    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-registration-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.553459    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret podName:45732897-8b95-499a-ba59-0fa7dd838e43 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:42.053441957 +0000 UTC m=+3.063381143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret") pod "global-pull-secret-syncer-vp95t" (UID: "45732897-8b95-499a-ba59-0fa7dd838e43") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553492    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-registration-dir\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfx96\" (UniqueName: \"kubernetes.io/projected/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-kube-api-access-wfx96\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:41.553686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553678    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-sys-fs\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.554325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01672869-3bc8-4041-a07b-824e31672388-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.554325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.553783    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45732897-8b95-499a-ba59-0fa7dd838e43-dbus\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:41.554325 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.553861    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:41.554325 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.553931    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs podName:ee6cadc3-f10f-4fb8-aeb1-600bee989f53 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:42.053912061 +0000 UTC m=+3.063851222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs") pod "network-metrics-daemon-jvdtr" (UID: "ee6cadc3-f10f-4fb8-aeb1-600bee989f53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:41.554325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.554072    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0173042e-1df4-4045-a58a-eec59e695ab4-serviceca\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.559817 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.559793    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:03:41.559817 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.559818    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:03:41.560001 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.559833    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gmpdq for pod openshift-network-diagnostics/network-check-target-zm7dd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:41.560001 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:41.559898    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq podName:e9837fad-99a1-4e1b-8621-942de05c00a0 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:42.059880081 +0000 UTC m=+3.069819239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gmpdq" (UniqueName: "kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq") pod "network-check-target-zm7dd" (UID: "e9837fad-99a1-4e1b-8621-942de05c00a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:41.562797 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.562771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56kcw\" (UniqueName: \"kubernetes.io/projected/01672869-3bc8-4041-a07b-824e31672388-kube-api-access-56kcw\") pod \"aws-ebs-csi-driver-node-9hzgj\" (UID: \"01672869-3bc8-4041-a07b-824e31672388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.563048 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.563030    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fxmt\" (UniqueName: \"kubernetes.io/projected/0173042e-1df4-4045-a58a-eec59e695ab4-kube-api-access-5fxmt\") pod \"node-ca-chd6x\" (UID: \"0173042e-1df4-4045-a58a-eec59e695ab4\") " pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:41.563121 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.563084    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfx96\" (UniqueName: \"kubernetes.io/projected/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-kube-api-access-wfx96\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:41.646459 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.646357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:03:41.655096 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.655069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qk9s6"
Jul 07 22:03:41.665320 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.665287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-st2hx"
Jul 07 22:03:41.672124 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.672101    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qm8br"
Jul 07 22:03:41.680406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.680381    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqtm2"
Jul 07 22:03:41.690359 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.690334    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p2n7p"
Jul 07 22:03:41.697177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.697146    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:03:41.706912 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.706878    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj"
Jul 07 22:03:41.717614 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:41.717585    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-chd6x"
Jul 07 22:03:42.057814 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.057764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:42.058017 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.057857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:42.058017 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.057928    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:42.058017 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.057972    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:42.058017 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.057999    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret podName:45732897-8b95-499a-ba59-0fa7dd838e43 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:43.057981079 +0000 UTC m=+4.067920263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret") pod "global-pull-secret-syncer-vp95t" (UID: "45732897-8b95-499a-ba59-0fa7dd838e43") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:42.058273 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.058041    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs podName:ee6cadc3-f10f-4fb8-aeb1-600bee989f53 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:43.058030819 +0000 UTC m=+4.067969977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs") pod "network-metrics-daemon-jvdtr" (UID: "ee6cadc3-f10f-4fb8-aeb1-600bee989f53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:42.159134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.159099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:42.159314 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.159284    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:03:42.159314 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.159305    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:03:42.159314 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.159316    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gmpdq for pod openshift-network-diagnostics/network-check-target-zm7dd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:42.159451 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.159380    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq podName:e9837fad-99a1-4e1b-8621-942de05c00a0 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:43.159363434 +0000 UTC m=+4.169302613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmpdq" (UniqueName: "kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq") pod "network-check-target-zm7dd" (UID: "e9837fad-99a1-4e1b-8621-942de05c00a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:42.382431 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.382368    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 21:58:41 +0000 UTC" deadline="2028-02-07 08:27:41.93065506 +0000 UTC"
Jul 07 22:03:42.382431 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.382427    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13906h23m59.548233904s"
Jul 07 22:03:42.495400 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:42.495360    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3792c4b_b141_4d31_883d_f52d5d2244b6.slice/crio-a3e0b635f50a84304db6a49f5a63ac599e4b7ae4c7b54161aa6217af5c35579a WatchSource:0}: Error finding container a3e0b635f50a84304db6a49f5a63ac599e4b7ae4c7b54161aa6217af5c35579a: Status 404 returned error can't find the container with id a3e0b635f50a84304db6a49f5a63ac599e4b7ae4c7b54161aa6217af5c35579a
Jul 07 22:03:42.497053 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:42.496975    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b838030_5954_453f_864a_fd2cfefd9bc5.slice/crio-37e6d8250f47aebfb09b2a8d665a44d53d4e9c6a8e4bb10794239384557d8eae WatchSource:0}: Error finding container 37e6d8250f47aebfb09b2a8d665a44d53d4e9c6a8e4bb10794239384557d8eae: Status 404 returned error can't find the container with id 37e6d8250f47aebfb09b2a8d665a44d53d4e9c6a8e4bb10794239384557d8eae
Jul 07 22:03:42.497965 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.497603    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:42.497965 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.497728    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:42.497965 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.497813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:42.497965 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:42.497912    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:42.498338 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:42.498268    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0173042e_1df4_4045_a58a_eec59e695ab4.slice/crio-c9ee975d470839d8a2ba826fe8adff342be29443e3abc8101c9cdbb47e1428aa WatchSource:0}: Error finding container c9ee975d470839d8a2ba826fe8adff342be29443e3abc8101c9cdbb47e1428aa: Status 404 returned error can't find the container with id c9ee975d470839d8a2ba826fe8adff342be29443e3abc8101c9cdbb47e1428aa
Jul 07 22:03:42.501398 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:42.501161    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb936e126_2515_4cdc_8812_9804616fea0b.slice/crio-e0d86040457753cff40a5e279b7c8c4d481661e97b37c6ab579c427382679f15 WatchSource:0}: Error finding container e0d86040457753cff40a5e279b7c8c4d481661e97b37c6ab579c427382679f15: Status 404 returned error can't find the container with id e0d86040457753cff40a5e279b7c8c4d481661e97b37c6ab579c427382679f15
Jul 07 22:03:42.508101 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.506781    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qm8br" event={"ID":"a3792c4b-b141-4d31-883d-f52d5d2244b6","Type":"ContainerStarted","Data":"a3e0b635f50a84304db6a49f5a63ac599e4b7ae4c7b54161aa6217af5c35579a"}
Jul 07 22:03:42.508658 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.508628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"48a8e9c93f63f513d7fd962ef108d0a6ef312d8f4c113912f72ea6766b56097a"}
Jul 07 22:03:42.509778 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:03:42.509750    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58bf2c7_55ae_4cfe_a6f2_6f1bbd7bc2fd.slice/crio-530f8b131409bc4d4b9b9e08595087871c671cb974338830737f61f535d2e147 WatchSource:0}: Error finding container 530f8b131409bc4d4b9b9e08595087871c671cb974338830737f61f535d2e147: Status 404 returned error can't find the container with id 530f8b131409bc4d4b9b9e08595087871c671cb974338830737f61f535d2e147
Jul 07 22:03:42.510167 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.510146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qk9s6" event={"ID":"b936e126-2515-4cdc-8812-9804616fea0b","Type":"ContainerStarted","Data":"e0d86040457753cff40a5e279b7c8c4d481661e97b37c6ab579c427382679f15"}
Jul 07 22:03:42.511912 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.511888    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-chd6x" event={"ID":"0173042e-1df4-4045-a58a-eec59e695ab4","Type":"ContainerStarted","Data":"c9ee975d470839d8a2ba826fe8adff342be29443e3abc8101c9cdbb47e1428aa"}
Jul 07 22:03:42.517538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:42.517516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p2n7p" event={"ID":"6b838030-5954-453f-864a-fd2cfefd9bc5","Type":"ContainerStarted","Data":"37e6d8250f47aebfb09b2a8d665a44d53d4e9c6a8e4bb10794239384557d8eae"}
Jul 07 22:03:43.067136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.066878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:43.067361 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.067195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:43.067361 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.067353    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:43.067487 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.067422    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs podName:ee6cadc3-f10f-4fb8-aeb1-600bee989f53 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:45.067401264 +0000 UTC m=+6.077340427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs") pod "network-metrics-daemon-jvdtr" (UID: "ee6cadc3-f10f-4fb8-aeb1-600bee989f53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:43.067891 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.067867    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:43.067970 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.067931    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret podName:45732897-8b95-499a-ba59-0fa7dd838e43 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:45.067914354 +0000 UTC m=+6.077853511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret") pod "global-pull-secret-syncer-vp95t" (UID: "45732897-8b95-499a-ba59-0fa7dd838e43") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:43.167593 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.167548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:43.167797 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.167777    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:03:43.167861 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.167804    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:03:43.167861 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.167818    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gmpdq for pod openshift-network-diagnostics/network-check-target-zm7dd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:43.167974 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.167881    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq podName:e9837fad-99a1-4e1b-8621-942de05c00a0 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:45.167860402 +0000 UTC m=+6.177799564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmpdq" (UniqueName: "kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq") pod "network-check-target-zm7dd" (UID: "e9837fad-99a1-4e1b-8621-942de05c00a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:43.382964 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.382810    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 21:58:41 +0000 UTC" deadline="2028-01-04 01:12:59.566808625 +0000 UTC"
Jul 07 22:03:43.382964 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.382879    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13083h9m16.183934063s"
Jul 07 22:03:43.498858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.498823    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:43.499044 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:43.498971    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:43.527007 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.526249    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal" event={"ID":"2a83507c3630b4c4defb443358b1b6c0","Type":"ContainerStarted","Data":"9704ac966c45eef21ae81cdc0c84fff9392cc7be979f11e0c3ae016100e0b534"}
Jul 07 22:03:43.532249 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.532164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-st2hx" event={"ID":"2c3ab11d-324d-413c-b281-5ccef1f98d5e","Type":"ContainerStarted","Data":"44e4a6e03eb9b5d3d0704eaea032efecce8db6273de481669f102c84b67ec89a"}
Jul 07 22:03:43.538986 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.538650    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerStarted","Data":"29d70c40b0439737f933c6443b104d622d42aa7f6fe94d41d76a82ba6ac77bce"}
Jul 07 22:03:43.546976 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.546857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj" event={"ID":"01672869-3bc8-4041-a07b-824e31672388","Type":"ContainerStarted","Data":"d2ac309fab383718a42ea3d5595a8bdc8dd900f6a1735b34c730cc19aba85e61"}
Jul 07 22:03:43.572597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.572557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7nskk" event={"ID":"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd","Type":"ContainerStarted","Data":"530f8b131409bc4d4b9b9e08595087871c671cb974338830737f61f535d2e147"}
Jul 07 22:03:43.580807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.580771    2573 generic.go:356] "Generic (PLEG): container finished" podID="5ac5ef4d7f01d69323447b7871b88f1d" containerID="43da2a152dc29e94871f9394a8a16c83ab8e6b1b5f85614650b04843e3a607d1" exitCode=0
Jul 07 22:03:43.580977 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.580818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal" event={"ID":"5ac5ef4d7f01d69323447b7871b88f1d","Type":"ContainerDied","Data":"43da2a152dc29e94871f9394a8a16c83ab8e6b1b5f85614650b04843e3a607d1"}
Jul 07 22:03:43.596379 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:43.596320    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-213.ec2.internal" podStartSLOduration=2.596297537 podStartE2EDuration="2.596297537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:03:43.541969151 +0000 UTC m=+4.551908334" watchObservedRunningTime="2026-07-07 22:03:43.596297537 +0000 UTC m=+4.606236720"
Jul 07 22:03:44.497734 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:44.497698    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:44.498249 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:44.497841    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:44.498406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:44.498246    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:44.498406 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:44.498362    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:44.599786 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:44.599724    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal" event={"ID":"5ac5ef4d7f01d69323447b7871b88f1d","Type":"ContainerStarted","Data":"1a24edbc89e61eccdded50b6360245da166988391d9af5b4669a737b5a17e5ac"}
Jul 07 22:03:45.094968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:45.094928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:45.095177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:45.095015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:45.095254 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.095175    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:45.095341 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.095258    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs podName:ee6cadc3-f10f-4fb8-aeb1-600bee989f53 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:49.095222609 +0000 UTC m=+10.105161769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs") pod "network-metrics-daemon-jvdtr" (UID: "ee6cadc3-f10f-4fb8-aeb1-600bee989f53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:45.095770 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.095685    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:45.095770 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.095742    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret podName:45732897-8b95-499a-ba59-0fa7dd838e43 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:49.095724034 +0000 UTC m=+10.105663198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret") pod "global-pull-secret-syncer-vp95t" (UID: "45732897-8b95-499a-ba59-0fa7dd838e43") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:45.196213 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:45.196172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:45.196832 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.196796    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:03:45.196832 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.196830    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:03:45.200935 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.196858    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gmpdq for pod openshift-network-diagnostics/network-check-target-zm7dd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:45.200935 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.200433    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq podName:e9837fad-99a1-4e1b-8621-942de05c00a0 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:49.200395782 +0000 UTC m=+10.210334963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmpdq" (UniqueName: "kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq") pod "network-check-target-zm7dd" (UID: "e9837fad-99a1-4e1b-8621-942de05c00a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:45.500589 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:45.500557    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:45.501065 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:45.500688    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:46.497664 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:46.497626    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:46.497855 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:46.497750    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:46.498181 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:46.498162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:46.498309 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:46.498281    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:47.499825 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:47.499800    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:47.500335 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:47.499915    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:48.497893 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:48.497852    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:48.498080 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:48.497999    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:48.498387 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:48.498356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:48.498497 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:48.498470    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:49.131893 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:49.131843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:49.132390 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:49.131951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:49.132390 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.131981    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:49.132390 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.132065    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret podName:45732897-8b95-499a-ba59-0fa7dd838e43 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:57.132040819 +0000 UTC m=+18.141979980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret") pod "global-pull-secret-syncer-vp95t" (UID: "45732897-8b95-499a-ba59-0fa7dd838e43") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:49.132390 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.132089    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:49.132390 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.132146    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs podName:ee6cadc3-f10f-4fb8-aeb1-600bee989f53 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:57.132128356 +0000 UTC m=+18.142067515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs") pod "network-metrics-daemon-jvdtr" (UID: "ee6cadc3-f10f-4fb8-aeb1-600bee989f53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:49.232766 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:49.232731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:49.232957 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.232918    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:03:49.232957 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.232946    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:03:49.232957 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.232958    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gmpdq for pod openshift-network-diagnostics/network-check-target-zm7dd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:49.233102 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.233018    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq podName:e9837fad-99a1-4e1b-8621-942de05c00a0 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:57.232998908 +0000 UTC m=+18.242938079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmpdq" (UniqueName: "kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq") pod "network-check-target-zm7dd" (UID: "e9837fad-99a1-4e1b-8621-942de05c00a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:49.502873 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:49.502837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:49.503034 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:49.502967    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:50.497729 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:50.497697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:50.498173 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:50.497827    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:50.498173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:50.497697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:50.498312 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:50.498290    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:51.497759 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:51.497726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:51.498106 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:51.497832    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:52.498713 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:52.498035    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:52.498713 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:52.498191    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:52.498713 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:52.498570    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:52.498713 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:52.498670    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:53.498337 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:53.498305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:53.498507 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:53.498443    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:54.498226 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:54.498175    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:54.498688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:54.498187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:54.498688 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:54.498307    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:54.498688 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:54.498382    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:55.497512 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:55.497475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:55.497681 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:55.497606    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:56.498259 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:56.498226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:56.498704 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:56.498241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:56.498704 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:56.498353    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:56.498704 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:56.498469    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:57.196065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:57.196032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:57.196263 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:57.196085    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:57.196263 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.196192    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:57.196263 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.196214    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:57.196413 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.196275    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret podName:45732897-8b95-499a-ba59-0fa7dd838e43 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:13.196255651 +0000 UTC m=+34.206194827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret") pod "global-pull-secret-syncer-vp95t" (UID: "45732897-8b95-499a-ba59-0fa7dd838e43") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:03:57.196413 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.196294    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs podName:ee6cadc3-f10f-4fb8-aeb1-600bee989f53 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:13.1962833 +0000 UTC m=+34.206222456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs") pod "network-metrics-daemon-jvdtr" (UID: "ee6cadc3-f10f-4fb8-aeb1-600bee989f53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:03:57.296927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:57.296882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:57.297084 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.297064    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:03:57.297123 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.297089    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:03:57.297123 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.297103    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gmpdq for pod openshift-network-diagnostics/network-check-target-zm7dd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:57.297187 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.297158    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq podName:e9837fad-99a1-4e1b-8621-942de05c00a0 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:13.297139124 +0000 UTC m=+34.307078281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmpdq" (UniqueName: "kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq") pod "network-check-target-zm7dd" (UID: "e9837fad-99a1-4e1b-8621-942de05c00a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:03:57.497503 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:57.497436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:57.497652 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:57.497566    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:03:58.498293 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:58.498253    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:03:58.498293 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:58.498290    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:03:58.498829 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:58.498414    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:03:58.498829 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:58.498537    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:03:59.499045 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:03:59.499011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:03:59.499471 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:03:59.499115    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:00.497478 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:00.497439    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:00.497478 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:00.497483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:00.497701 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:00.497570    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:00.497701 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:00.497684    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:01.498124 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:01.498085    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:01.498554 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:01.498234    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:02.498388 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.498041    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:02.499066 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.498110    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:02.499066 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:02.498490    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:02.499066 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:02.498556    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:02.604492 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.604408    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 22:04:02.640527 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.640501    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:04:02.640837 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.640814    2573 generic.go:356] "Generic (PLEG): container finished" podID="2407265e-b9c0-44bd-9cf8-7dad898eb0e8" containerID="c3bbc54c3e879e825b11620525aa835a40f4617db812685d03631288195a3d72" exitCode=1
Jul 07 22:04:02.640912 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.640891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"815364aee6360447a5538be43976dbf9c6aaec084d2a562eec63f125e67f4542"}
Jul 07 22:04:02.640970 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.640957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"14dced344bcedc19f9dd7892f7c95361520cda93c866c7833d7fe4b4e2022bd2"}
Jul 07 22:04:02.641011 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.640996    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"e76b3664a45535bbedb3bd813b46ee68c7fde8c4048e4a890d9700995520ea3c"}
Jul 07 22:04:02.641048 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.641025    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"9b8ed38d80165561c0837dd9c1642cf8f50602558a0be1f25522be4947c05c2a"}
Jul 07 22:04:02.641099 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.641053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerDied","Data":"c3bbc54c3e879e825b11620525aa835a40f4617db812685d03631288195a3d72"}
Jul 07 22:04:02.641151 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.641102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"d64a4bbd1ff56fba7115a178df8532b07e7e76ff5924c3241b419be787379fda"}
Jul 07 22:04:02.642127 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.642095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-st2hx" event={"ID":"2c3ab11d-324d-413c-b281-5ccef1f98d5e","Type":"ContainerStarted","Data":"2d270b8ec8e0055c5c68419dfa95a59b60fa26921bb0ef93ae48fbc0c39bb059"}
Jul 07 22:04:02.643479 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.643459    2573 generic.go:356] "Generic (PLEG): container finished" podID="556ac2bb-399c-4b5d-9ced-fc45a4a2ab08" containerID="1d4e93f574c8ad9e89e42e7c46ac004b917d9a2ca1b64e9ce9d917ad6bdcaf3d" exitCode=0
Jul 07 22:04:02.643592 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.643485    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerDied","Data":"1d4e93f574c8ad9e89e42e7c46ac004b917d9a2ca1b64e9ce9d917ad6bdcaf3d"}
Jul 07 22:04:02.645383 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.645357    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj" event={"ID":"01672869-3bc8-4041-a07b-824e31672388","Type":"ContainerStarted","Data":"dd36cfd9a810b3c15853a6e58a7293731a366b4b6d47751823686edfbc8a1635"}
Jul 07 22:04:02.645506 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.645413    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj" event={"ID":"01672869-3bc8-4041-a07b-824e31672388","Type":"ContainerStarted","Data":"eada699d3770573ae45416148a4823799bc5f14bd965ecbc23967a39bc7b585b"}
Jul 07 22:04:02.646766 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.646738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qk9s6" event={"ID":"b936e126-2515-4cdc-8812-9804616fea0b","Type":"ContainerStarted","Data":"7cb82521bcb7dd1c1def5481485b6a9b81a1f113d0cd75a79d860a60b51a12c9"}
Jul 07 22:04:02.648066 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.648048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-chd6x" event={"ID":"0173042e-1df4-4045-a58a-eec59e695ab4","Type":"ContainerStarted","Data":"8cfc7386ac4c1d69b82ce1047f97f19599c1c79a660ca0a5332455545c22b307"}
Jul 07 22:04:02.649393 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.649375    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qm8br" event={"ID":"a3792c4b-b141-4d31-883d-f52d5d2244b6","Type":"ContainerStarted","Data":"2ddf0eeae6ed1f5e119270e98a5cc996b170acc5cdedcc201e03a33d5afb5208"}
Jul 07 22:04:02.650624 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.650609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7nskk" event={"ID":"b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd","Type":"ContainerStarted","Data":"2f30e914a75abe80c38ed9e5bcb41443eef633956e05dc769bc0a58a302090b9"}
Jul 07 22:04:02.657409 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.657373    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-213.ec2.internal" podStartSLOduration=21.65736224 podStartE2EDuration="21.65736224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:03:44.6156207 +0000 UTC m=+5.625559887" watchObservedRunningTime="2026-07-07 22:04:02.65736224 +0000 UTC m=+23.667301419"
Jul 07 22:04:02.660130 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.657835    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-st2hx" podStartSLOduration=3.654949652 podStartE2EDuration="22.657818144s" totalImagesPullingTime="19.002868492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:02.657493491 +0000 UTC m=+23.667432665" watchObservedRunningTime="2026-07-07 22:04:02.657818144 +0000 UTC m=+23.667757323"
Jul 07 22:04:02.675642 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.675598    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qm8br" podStartSLOduration=3.609203868 podStartE2EDuration="22.675584977s" totalImagesPullingTime="19.066381109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:02.674681843 +0000 UTC m=+23.684621020" watchObservedRunningTime="2026-07-07 22:04:02.675584977 +0000 UTC m=+23.685524154"
Jul 07 22:04:02.709653 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.709602    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7nskk" podStartSLOduration=3.966472371 podStartE2EDuration="22.709585973s" totalImagesPullingTime="18.743113602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:02.709529081 +0000 UTC m=+23.719468259" watchObservedRunningTime="2026-07-07 22:04:02.709585973 +0000 UTC m=+23.719525150"
Jul 07 22:04:02.724272 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.724230    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-chd6x" podStartSLOduration=3.966243072 podStartE2EDuration="22.724190814s" totalImagesPullingTime="18.757947742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:02.723703214 +0000 UTC m=+23.733642391" watchObservedRunningTime="2026-07-07 22:04:02.724190814 +0000 UTC m=+23.734129992"
Jul 07 22:04:02.743775 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:02.743725    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qk9s6" podStartSLOduration=3.739086935 podStartE2EDuration="22.743711167s" totalImagesPullingTime="19.004624232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:02.743253867 +0000 UTC m=+23.753193044" watchObservedRunningTime="2026-07-07 22:04:02.743711167 +0000 UTC m=+23.753650356"
Jul 07 22:04:03.407650 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.407545    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T22:04:02.604423276Z","UUID":"4b1d8039-c47d-4784-89ab-6b96b0af2009","Handler":null,"Name":"","Endpoint":""}
Jul 07 22:04:03.409459 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.409434    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 22:04:03.409597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.409479    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 22:04:03.501209 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.501163    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:03.501612 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:03.501285    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:03.655041 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.654950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj" event={"ID":"01672869-3bc8-4041-a07b-824e31672388","Type":"ContainerStarted","Data":"dc51a46c34bd37d946d6ee756763714eb013efdb54118592b58d96a3110a1b2a"}
Jul 07 22:04:03.656580 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.656511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p2n7p" event={"ID":"6b838030-5954-453f-864a-fd2cfefd9bc5","Type":"ContainerStarted","Data":"874a0abc04f63029b14f78c3d4e761685f36568e40f9e0231cd68c73b84f17ca"}
Jul 07 22:04:03.671092 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.671045    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hzgj" podStartSLOduration=3.396662597 podStartE2EDuration="23.671030825s" totalImagesPullingTime="20.274368228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:03.670806336 +0000 UTC m=+24.680745514" watchObservedRunningTime="2026-07-07 22:04:03.671030825 +0000 UTC m=+24.680970003"
Jul 07 22:04:03.685239 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:03.685168    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p2n7p" podStartSLOduration=4.926532929 podStartE2EDuration="23.685150144s" totalImagesPullingTime="18.758617215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:03.684702037 +0000 UTC m=+24.694641217" watchObservedRunningTime="2026-07-07 22:04:03.685150144 +0000 UTC m=+24.695089328"
Jul 07 22:04:04.497467 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:04.497436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:04.497467 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:04.497472    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:04.497739 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:04.497571    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:04.497739 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:04.497702    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:04.664338 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:04.664259    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:04:04.665043 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:04.665013    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"574b82a1a6135da4385fede1584637d92aa88edf234e813a23d09c85c4a26884"}
Jul 07 22:04:05.498092 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:05.498057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:05.498278 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:05.498166    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:06.497828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:06.497605    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:06.498231 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:06.497658    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:06.498231 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:06.497952    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:06.498231 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:06.497994    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:06.586981 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:06.586944    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:04:06.587831 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:06.587800    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:04:06.668718 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:06.668686    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:04:06.669123 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:06.669108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7nskk"
Jul 07 22:04:07.500608 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.500445    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:07.501178 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:07.500674    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:07.673117 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.673092    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:04:07.673481 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.673458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"cfffedf8ac3acc97616283c25ac1cd4db32a4f1e2783ec1aaa225d6afd47b4b6"}
Jul 07 22:04:07.673829 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.673793    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:04:07.673982 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.673910    2573 scope.go:117] "RemoveContainer" containerID="c3bbc54c3e879e825b11620525aa835a40f4617db812685d03631288195a3d72"
Jul 07 22:04:07.678894 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.678866    2573 generic.go:356] "Generic (PLEG): container finished" podID="556ac2bb-399c-4b5d-9ced-fc45a4a2ab08" containerID="b451c942e215ae3c8c5d9dba6de1885e5f5de7a5ec1fb5f5e51dfee27d9452cb" exitCode=0
Jul 07 22:04:07.679000 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.678949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerDied","Data":"b451c942e215ae3c8c5d9dba6de1885e5f5de7a5ec1fb5f5e51dfee27d9452cb"}
Jul 07 22:04:07.691534 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:07.691512    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:04:08.498271 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.498234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:08.498271 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.498257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:08.498597 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:08.498401    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:08.498597 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:08.498486    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:08.685777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.685756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:04:08.686239 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.686181    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" event={"ID":"2407265e-b9c0-44bd-9cf8-7dad898eb0e8","Type":"ContainerStarted","Data":"da139914f78ef4b5a996f5d11cddc0f15e64ecc298febfe194101ced94996146"}
Jul 07 22:04:08.686393 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.686376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:04:08.686447 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.686435    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:04:08.688676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.688652    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerStarted","Data":"77cfaf93edc0d622e2e4b39f96b7b6c0937a319a91c08bb1c6961a131cb4dbe9"}
Jul 07 22:04:08.702064 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.702043    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:04:08.715383 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.715329    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8" podStartSLOduration=9.6550545 podStartE2EDuration="28.715309465s" totalImagesPullingTime="19.060254965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:08.713059108 +0000 UTC m=+29.722998285" watchObservedRunningTime="2026-07-07 22:04:08.715309465 +0000 UTC m=+29.725248644"
Jul 07 22:04:08.725696 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.725670    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zm7dd"]
Jul 07 22:04:08.725842 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.725827    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:08.725941 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:08.725922    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:08.728778 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.728753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vp95t"]
Jul 07 22:04:08.728883 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.728842    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:08.728950 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:08.728930    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:08.729414 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.729392    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jvdtr"]
Jul 07 22:04:08.729506 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:08.729493    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:08.729617 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:08.729596    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:09.692232 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:09.692180    2573 generic.go:356] "Generic (PLEG): container finished" podID="556ac2bb-399c-4b5d-9ced-fc45a4a2ab08" containerID="77cfaf93edc0d622e2e4b39f96b7b6c0937a319a91c08bb1c6961a131cb4dbe9" exitCode=0
Jul 07 22:04:09.692606 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:09.692231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerDied","Data":"77cfaf93edc0d622e2e4b39f96b7b6c0937a319a91c08bb1c6961a131cb4dbe9"}
Jul 07 22:04:10.497515 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:10.497482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:10.497670 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:10.497490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:10.497670 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:10.497602    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:10.497670 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:10.497601    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:10.497769 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:10.497668    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:10.497769 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:10.497739    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:10.696795 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:10.696643    2573 generic.go:356] "Generic (PLEG): container finished" podID="556ac2bb-399c-4b5d-9ced-fc45a4a2ab08" containerID="dbcee626ae684bda0e0e4e14f3ac7b698c0612b1253c3b309315f198a0c674e4" exitCode=0
Jul 07 22:04:10.697144 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:10.696717    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerDied","Data":"dbcee626ae684bda0e0e4e14f3ac7b698c0612b1253c3b309315f198a0c674e4"}
Jul 07 22:04:12.498005 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:12.497970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:12.498536 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:12.498012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:12.498536 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:12.497979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:12.498536 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:12.498088    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zm7dd" podUID="e9837fad-99a1-4e1b-8621-942de05c00a0"
Jul 07 22:04:12.498536 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:12.498150    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vp95t" podUID="45732897-8b95-499a-ba59-0fa7dd838e43"
Jul 07 22:04:12.498536 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:12.498246    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvdtr" podUID="ee6cadc3-f10f-4fb8-aeb1-600bee989f53"
Jul 07 22:04:13.209345 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:13.209310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:13.209545 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:13.209358    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:13.209545 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.209461    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:04:13.209545 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.209469    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:04:13.209545 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.209520    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret podName:45732897-8b95-499a-ba59-0fa7dd838e43 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:45.209504019 +0000 UTC m=+66.219443179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret") pod "global-pull-secret-syncer-vp95t" (UID: "45732897-8b95-499a-ba59-0fa7dd838e43") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:04:13.209545 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.209535    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs podName:ee6cadc3-f10f-4fb8-aeb1-600bee989f53 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:45.209528436 +0000 UTC m=+66.219467592 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs") pod "network-metrics-daemon-jvdtr" (UID: "ee6cadc3-f10f-4fb8-aeb1-600bee989f53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:04:13.310331 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:13.310296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:13.310510 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.310440    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:04:13.310510 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.310457    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:04:13.310510 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.310467    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gmpdq for pod openshift-network-diagnostics/network-check-target-zm7dd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:04:13.310641 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:13.310516    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq podName:e9837fad-99a1-4e1b-8621-942de05c00a0 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:45.310502268 +0000 UTC m=+66.320441425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmpdq" (UniqueName: "kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq") pod "network-check-target-zm7dd" (UID: "e9837fad-99a1-4e1b-8621-942de05c00a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:04:14.269168 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.269138    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-213.ec2.internal" event="NodeReady"
Jul 07 22:04:14.269658 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.269294    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 22:04:14.311575 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.311544    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8q8w4"]
Jul 07 22:04:14.334843 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.334818    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jhlwf"]
Jul 07 22:04:14.334985 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.334950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.337287 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.337223    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 22:04:14.337408 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.337321    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 22:04:14.337468 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.337427    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kp4p7\""
Jul 07 22:04:14.354666 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.354633    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8q8w4"]
Jul 07 22:04:14.354791 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.354678    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jhlwf"]
Jul 07 22:04:14.354791 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.354743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.356893 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.356874    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8gs5j\""
Jul 07 22:04:14.357003 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.356874    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 22:04:14.357065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.357045    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 22:04:14.357102 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.357092    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 22:04:14.418066 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.418037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b44371e-723d-447f-b561-b905c2c22dc2-tmp-dir\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.418253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.418087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kvt\" (UniqueName: \"kubernetes.io/projected/9b44371e-723d-447f-b561-b905c2c22dc2-kube-api-access-c9kvt\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.418253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.418107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.418253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.418170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b44371e-723d-447f-b561-b905c2c22dc2-config-volume\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.498441 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.498414    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:14.498588 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.498414    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:14.498659 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.498414    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:14.500946 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.500919    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hdlmc\""
Jul 07 22:04:14.501084 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.500919    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 22:04:14.501084 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.500978    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 22:04:14.501314 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.501294    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 22:04:14.501314 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.501316    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 22:04:14.501496 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.501355    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p2w6w\""
Jul 07 22:04:14.518673 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.518653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4693966-f5e2-4ec8-89e0-8276685f4770-cert\") pod \"ingress-canary-jhlwf\" (UID: \"c4693966-f5e2-4ec8-89e0-8276685f4770\") " pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.518768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.518685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b44371e-723d-447f-b561-b905c2c22dc2-tmp-dir\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.518768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.518708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kvt\" (UniqueName: \"kubernetes.io/projected/9b44371e-723d-447f-b561-b905c2c22dc2-kube-api-access-c9kvt\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.518768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.518726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.518768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.518755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b44371e-723d-447f-b561-b905c2c22dc2-config-volume\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.518958 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.518771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9kpl\" (UniqueName: \"kubernetes.io/projected/c4693966-f5e2-4ec8-89e0-8276685f4770-kube-api-access-l9kpl\") pod \"ingress-canary-jhlwf\" (UID: \"c4693966-f5e2-4ec8-89e0-8276685f4770\") " pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.518958 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:14.518906    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:04:14.519051 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:14.518965    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls podName:9b44371e-723d-447f-b561-b905c2c22dc2 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:15.01894615 +0000 UTC m=+36.028885321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls") pod "dns-default-8q8w4" (UID: "9b44371e-723d-447f-b561-b905c2c22dc2") : secret "dns-default-metrics-tls" not found
Jul 07 22:04:14.519255 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.519236    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b44371e-723d-447f-b561-b905c2c22dc2-tmp-dir\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.519327 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.519310    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b44371e-723d-447f-b561-b905c2c22dc2-config-volume\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.529099 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.529080    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kvt\" (UniqueName: \"kubernetes.io/projected/9b44371e-723d-447f-b561-b905c2c22dc2-kube-api-access-c9kvt\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:14.619182 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.619097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9kpl\" (UniqueName: \"kubernetes.io/projected/c4693966-f5e2-4ec8-89e0-8276685f4770-kube-api-access-l9kpl\") pod \"ingress-canary-jhlwf\" (UID: \"c4693966-f5e2-4ec8-89e0-8276685f4770\") " pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.619182 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.619166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4693966-f5e2-4ec8-89e0-8276685f4770-cert\") pod \"ingress-canary-jhlwf\" (UID: \"c4693966-f5e2-4ec8-89e0-8276685f4770\") " pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.622298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.622272    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4693966-f5e2-4ec8-89e0-8276685f4770-cert\") pod \"ingress-canary-jhlwf\" (UID: \"c4693966-f5e2-4ec8-89e0-8276685f4770\") " pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.628136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.628111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9kpl\" (UniqueName: \"kubernetes.io/projected/c4693966-f5e2-4ec8-89e0-8276685f4770-kube-api-access-l9kpl\") pod \"ingress-canary-jhlwf\" (UID: \"c4693966-f5e2-4ec8-89e0-8276685f4770\") " pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.664256 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.664222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jhlwf"
Jul 07 22:04:14.854781 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:14.854754    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jhlwf"]
Jul 07 22:04:14.857870 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:14.857846    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4693966_f5e2_4ec8_89e0_8276685f4770.slice/crio-50d7e1a9725eb3a7b0592bd386c97e42c15bcf093f5b567e86648d407e8ca344 WatchSource:0}: Error finding container 50d7e1a9725eb3a7b0592bd386c97e42c15bcf093f5b567e86648d407e8ca344: Status 404 returned error can't find the container with id 50d7e1a9725eb3a7b0592bd386c97e42c15bcf093f5b567e86648d407e8ca344
Jul 07 22:04:15.022597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.022404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:15.022775 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:15.022568    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:04:15.022775 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:15.022760    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls podName:9b44371e-723d-447f-b561-b905c2c22dc2 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:16.022733323 +0000 UTC m=+37.032672493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls") pod "dns-default-8q8w4" (UID: "9b44371e-723d-447f-b561-b905c2c22dc2") : secret "dns-default-metrics-tls" not found
Jul 07 22:04:15.710173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.710133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jhlwf" event={"ID":"c4693966-f5e2-4ec8-89e0-8276685f4770","Type":"ContainerStarted","Data":"50d7e1a9725eb3a7b0592bd386c97e42c15bcf093f5b567e86648d407e8ca344"}
Jul 07 22:04:15.715302 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.715263    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"]
Jul 07 22:04:15.746801 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.746766    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"]
Jul 07 22:04:15.746952 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.746908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.750968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.750005    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:04:15.750968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.750051    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 22:04:15.750968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.750069    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 22:04:15.750968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.750011    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xrkrw\""
Jul 07 22:04:15.750968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.750401    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 22:04:15.760760 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.760740    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"]
Jul 07 22:04:15.760884 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.760856    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:15.763863 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.763588    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 22:04:15.763863 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.763642    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 22:04:15.763863 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.763671    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 22:04:15.763863 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.763798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cndbw\""
Jul 07 22:04:15.764870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.764850    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 22:04:15.778872 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.778839    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"]
Jul 07 22:04:15.778998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.778877    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"]
Jul 07 22:04:15.778998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.778900    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"]
Jul 07 22:04:15.778998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.778977    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"
Jul 07 22:04:15.781400 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.781383    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7gpxj\""
Jul 07 22:04:15.818176 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.818143    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"]
Jul 07 22:04:15.829048 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.829022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e3a766e-627f-47b3-ad07-26efa6ea42c7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.829048 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.829049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3a766e-627f-47b3-ad07-26efa6ea42c7-config\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.829303 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.829069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq69s\" (UniqueName: \"kubernetes.io/projected/7e3a766e-627f-47b3-ad07-26efa6ea42c7-kube-api-access-pq69s\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.838473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.838435    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-65lxg"]
Jul 07 22:04:15.838875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.838811    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:15.841490 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.841470    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 22:04:15.841581 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.841519    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z6wkv\""
Jul 07 22:04:15.841778 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.841749    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 22:04:15.864418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.864393    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"]
Jul 07 22:04:15.864563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.864429    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-65lxg"]
Jul 07 22:04:15.864563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.864517    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:15.867698 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.867672    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 22:04:15.867822 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.867745    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 22:04:15.867822 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.867773    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cdpb9\""
Jul 07 22:04:15.869858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.869829    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 22:04:15.869967 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.869927    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 22:04:15.874631 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.874609    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 22:04:15.925429 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.925391    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c74bdd4d6-xz24x"]
Jul 07 22:04:15.929389 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg6tt\" (UniqueName: \"kubernetes.io/projected/38aa15c2-9c3e-427a-87b1-c197b5f40a60-kube-api-access-lg6tt\") pod \"network-check-source-989f8b8dc-qh56q\" (UID: \"38aa15c2-9c3e-427a-87b1-c197b5f40a60\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"
Jul 07 22:04:15.929524 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96ee12d4-97f6-4312-abe7-825cc500e3fa-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:15.929524 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929455    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e3a766e-627f-47b3-ad07-26efa6ea42c7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.929524 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96795654-e144-4b33-941f-108a130aeed3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:15.929524 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:15.929739 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3a766e-627f-47b3-ad07-26efa6ea42c7-config\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.929739 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq69s\" (UniqueName: \"kubernetes.io/projected/7e3a766e-627f-47b3-ad07-26efa6ea42c7-kube-api-access-pq69s\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.929837 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:15.929837 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.929804    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfpld\" (UniqueName: \"kubernetes.io/projected/96ee12d4-97f6-4312-abe7-825cc500e3fa-kube-api-access-vfpld\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:15.930140 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.930122    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3a766e-627f-47b3-ad07-26efa6ea42c7-config\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.932936 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.932916    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e3a766e-627f-47b3-ad07-26efa6ea42c7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.944235 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.943911    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c74bdd4d6-xz24x"]
Jul 07 22:04:15.944235 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.944019    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:15.946383 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.946360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 22:04:15.946623 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.946600    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c748h\""
Jul 07 22:04:15.946933 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.946643    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 22:04:15.947028 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.946718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 22:04:15.947085 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.946726    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq69s\" (UniqueName: \"kubernetes.io/projected/7e3a766e-627f-47b3-ad07-26efa6ea42c7-kube-api-access-pq69s\") pod \"service-ca-operator-5d46d9ffd4-qrpdh\" (UID: \"7e3a766e-627f-47b3-ad07-26efa6ea42c7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:15.956651 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:15.956630    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 22:04:16.030496 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwxh\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-kube-api-access-6xwxh\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.030688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:16.030688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030549    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-installation-pull-secrets\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.030688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b338327-3e35-47fa-a01c-3015da2cc64d-ca-trust-extracted\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.030688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-trusted-ca\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.030688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-snapshots\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.030688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-certificates\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.030688 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.030650    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.030715    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert podName:96795654-e144-4b33-941f-108a130aeed3 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:16.53070113 +0000 UTC m=+37.540640290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nhd7r" (UID: "96795654-e144-4b33-941f-108a130aeed3") : secret "networking-console-plugin-cert" not found
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbp54\" (UniqueName: \"kubernetes.io/projected/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-kube-api-access-qbp54\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg6tt\" (UniqueName: \"kubernetes.io/projected/38aa15c2-9c3e-427a-87b1-c197b5f40a60-kube-api-access-lg6tt\") pod \"network-check-source-989f8b8dc-qh56q\" (UID: \"38aa15c2-9c3e-427a-87b1-c197b5f40a60\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-serving-cert\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-tmp\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96ee12d4-97f6-4312-abe7-825cc500e3fa-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-bound-sa-token\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.031002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.030955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96795654-e144-4b33-941f-108a130aeed3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:16.031473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.031130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:16.031473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.031168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-image-registry-private-configuration\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.031473 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.031302    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:16.031473 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.031375    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls podName:96ee12d4-97f6-4312-abe7-825cc500e3fa nodeName:}" failed. No retries permitted until 2026-07-07 22:04:16.531355903 +0000 UTC m=+37.541295073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-94mjg" (UID: "96ee12d4-97f6-4312-abe7-825cc500e3fa") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:16.031473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.031306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfpld\" (UniqueName: \"kubernetes.io/projected/96ee12d4-97f6-4312-abe7-825cc500e3fa-kube-api-access-vfpld\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:16.031473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.031418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:16.031719 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.031487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.031719 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.031579    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:04:16.031719 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.031635    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls podName:9b44371e-723d-447f-b561-b905c2c22dc2 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:18.031619885 +0000 UTC m=+39.041559041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls") pod "dns-default-8q8w4" (UID: "9b44371e-723d-447f-b561-b905c2c22dc2") : secret "dns-default-metrics-tls" not found
Jul 07 22:04:16.031719 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.031698    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96ee12d4-97f6-4312-abe7-825cc500e3fa-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:16.031846 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.031718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96795654-e144-4b33-941f-108a130aeed3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:16.039882 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.039858    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg6tt\" (UniqueName: \"kubernetes.io/projected/38aa15c2-9c3e-427a-87b1-c197b5f40a60-kube-api-access-lg6tt\") pod \"network-check-source-989f8b8dc-qh56q\" (UID: \"38aa15c2-9c3e-427a-87b1-c197b5f40a60\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"
Jul 07 22:04:16.040396 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.040375    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfpld\" (UniqueName: \"kubernetes.io/projected/96ee12d4-97f6-4312-abe7-825cc500e3fa-kube-api-access-vfpld\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:16.043875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.043842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:16.060211 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.060167    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"
Jul 07 22:04:16.089232 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.089190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"
Jul 07 22:04:16.132854 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.132813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-image-registry-private-configuration\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.132992 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.132909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.132992 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.132939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwxh\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-kube-api-access-6xwxh\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.133094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.132990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-installation-pull-secrets\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.133094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b338327-3e35-47fa-a01c-3015da2cc64d-ca-trust-extracted\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.133094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-trusted-ca\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.133094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-snapshots\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.133300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-certificates\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.133300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.133300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbp54\" (UniqueName: \"kubernetes.io/projected/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-kube-api-access-qbp54\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.133300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.133300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-serving-cert\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.133300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-tmp\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.133300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.133290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-bound-sa-token\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.133976    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.133999    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c74bdd4d6-xz24x: secret "image-registry-tls" not found
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.134068    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls podName:4b338327-3e35-47fa-a01c-3015da2cc64d nodeName:}" failed. No retries permitted until 2026-07-07 22:04:16.634049189 +0000 UTC m=+37.643988345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls") pod "image-registry-7c74bdd4d6-xz24x" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d") : secret "image-registry-tls" not found
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.134106    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-tmp\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.134106    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.134145    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-trusted-ca\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.134549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b338327-3e35-47fa-a01c-3015da2cc64d-ca-trust-extracted\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.134593    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.134911    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-snapshots\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.135225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.135158    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-certificates\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.135777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.135749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-image-registry-private-configuration\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.136641 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.136621    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-installation-pull-secrets\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.137660 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.137642    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-serving-cert\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.143550 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.143515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:16.145374 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.145349    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwxh\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-kube-api-access-6xwxh\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.145597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.145581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbp54\" (UniqueName: \"kubernetes.io/projected/5c0f4165-dc58-4c3c-a01e-c10a38f0506e-kube-api-access-qbp54\") pod \"insights-operator-5c847dcfc4-65lxg\" (UID: \"5c0f4165-dc58-4c3c-a01e-c10a38f0506e\") " pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.145721 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.145702    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-bound-sa-token\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.174837 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.174810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-65lxg"
Jul 07 22:04:16.244949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.244913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:16.537437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.536606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:16.537437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.536738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:16.537437 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.536923    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:04:16.537437 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.537008    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert podName:96795654-e144-4b33-941f-108a130aeed3 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:17.536985903 +0000 UTC m=+38.546925080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nhd7r" (UID: "96795654-e144-4b33-941f-108a130aeed3") : secret "networking-console-plugin-cert" not found
Jul 07 22:04:16.537437 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.537353    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:16.537437 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.537403    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls podName:96ee12d4-97f6-4312-abe7-825cc500e3fa nodeName:}" failed. No retries permitted until 2026-07-07 22:04:17.537388663 +0000 UTC m=+38.547327828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-94mjg" (UID: "96ee12d4-97f6-4312-abe7-825cc500e3fa") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:16.637464 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.637434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:16.637626 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.637565    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:04:16.637626 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.637578    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c74bdd4d6-xz24x: secret "image-registry-tls" not found
Jul 07 22:04:16.637706 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:16.637650    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls podName:4b338327-3e35-47fa-a01c-3015da2cc64d nodeName:}" failed. No retries permitted until 2026-07-07 22:04:17.637632473 +0000 UTC m=+38.647571631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls") pod "image-registry-7c74bdd4d6-xz24x" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d") : secret "image-registry-tls" not found
Jul 07 22:04:16.640337 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.640309    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q"]
Jul 07 22:04:16.643771 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.643746    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh"]
Jul 07 22:04:16.644167 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:16.644144    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38aa15c2_9c3e_427a_87b1_c197b5f40a60.slice/crio-6f506c53badb2b8dea64fa1918fd4da659ebd153983a05704e65d1a9f54532a8 WatchSource:0}: Error finding container 6f506c53badb2b8dea64fa1918fd4da659ebd153983a05704e65d1a9f54532a8: Status 404 returned error can't find the container with id 6f506c53badb2b8dea64fa1918fd4da659ebd153983a05704e65d1a9f54532a8
Jul 07 22:04:16.647757 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:16.647735    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3a766e_627f_47b3_ad07_26efa6ea42c7.slice/crio-977765fa853ff1e8d123e6c2e2fd45d2219e94bda5b27d7d66035593bda83010 WatchSource:0}: Error finding container 977765fa853ff1e8d123e6c2e2fd45d2219e94bda5b27d7d66035593bda83010: Status 404 returned error can't find the container with id 977765fa853ff1e8d123e6c2e2fd45d2219e94bda5b27d7d66035593bda83010
Jul 07 22:04:16.657039 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.657017    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-65lxg"]
Jul 07 22:04:16.659984 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:16.659961    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0f4165_dc58_4c3c_a01e_c10a38f0506e.slice/crio-f4f5c35b09f85965172bebe66c928e356cdf68bf900104d0e7d5cc328bd6ac09 WatchSource:0}: Error finding container f4f5c35b09f85965172bebe66c928e356cdf68bf900104d0e7d5cc328bd6ac09: Status 404 returned error can't find the container with id f4f5c35b09f85965172bebe66c928e356cdf68bf900104d0e7d5cc328bd6ac09
Jul 07 22:04:16.713710 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.713675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65lxg" event={"ID":"5c0f4165-dc58-4c3c-a01e-c10a38f0506e","Type":"ContainerStarted","Data":"f4f5c35b09f85965172bebe66c928e356cdf68bf900104d0e7d5cc328bd6ac09"}
Jul 07 22:04:16.714773 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.714742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q" event={"ID":"38aa15c2-9c3e-427a-87b1-c197b5f40a60","Type":"ContainerStarted","Data":"6f506c53badb2b8dea64fa1918fd4da659ebd153983a05704e65d1a9f54532a8"}
Jul 07 22:04:16.715789 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:16.715769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh" event={"ID":"7e3a766e-627f-47b3-ad07-26efa6ea42c7","Type":"ContainerStarted","Data":"977765fa853ff1e8d123e6c2e2fd45d2219e94bda5b27d7d66035593bda83010"}
Jul 07 22:04:17.546394 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:17.546189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:17.546542 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:17.546460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:17.546542 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:17.546372    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:17.546542 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:17.546527    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls podName:96ee12d4-97f6-4312-abe7-825cc500e3fa nodeName:}" failed. No retries permitted until 2026-07-07 22:04:19.546511475 +0000 UTC m=+40.556450630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-94mjg" (UID: "96ee12d4-97f6-4312-abe7-825cc500e3fa") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:17.546716 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:17.546558    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:04:17.546716 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:17.546595    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert podName:96795654-e144-4b33-941f-108a130aeed3 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:19.546584666 +0000 UTC m=+40.556523822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nhd7r" (UID: "96795654-e144-4b33-941f-108a130aeed3") : secret "networking-console-plugin-cert" not found
Jul 07 22:04:17.646790 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:17.646744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:17.647245 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:17.647217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:17.647427 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:17.647412    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:04:17.647507 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:17.647430    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c74bdd4d6-xz24x: secret "image-registry-tls" not found
Jul 07 22:04:17.647507 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:17.647483    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls podName:4b338327-3e35-47fa-a01c-3015da2cc64d nodeName:}" failed. No retries permitted until 2026-07-07 22:04:19.64746615 +0000 UTC m=+40.657405312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls") pod "image-registry-7c74bdd4d6-xz24x" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d") : secret "image-registry-tls" not found
Jul 07 22:04:17.725790 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:17.725675    2573 generic.go:356] "Generic (PLEG): container finished" podID="556ac2bb-399c-4b5d-9ced-fc45a4a2ab08" containerID="08f22993e08c971609b73bd2d8baeb9bd4cf9f04ccec5960cee40f639a371b25" exitCode=0
Jul 07 22:04:17.725790 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:17.725723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerDied","Data":"08f22993e08c971609b73bd2d8baeb9bd4cf9f04ccec5960cee40f639a371b25"}
Jul 07 22:04:17.748661 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:17.748614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:18.064470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:18.064431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:18.064699 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:18.064678    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:04:18.064795 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:18.064747    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls podName:9b44371e-723d-447f-b561-b905c2c22dc2 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:22.06472876 +0000 UTC m=+43.074667921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls") pod "dns-default-8q8w4" (UID: "9b44371e-723d-447f-b561-b905c2c22dc2") : secret "dns-default-metrics-tls" not found
Jul 07 22:04:18.601268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:18.601217    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:18.701658 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:18.701624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:18.733659 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:18.733470    2573 generic.go:356] "Generic (PLEG): container finished" podID="556ac2bb-399c-4b5d-9ced-fc45a4a2ab08" containerID="fdb8bf145ac0ed2e9bdea0643d77ba043c8fce5af544e3799155cef8d1e4041f" exitCode=0
Jul 07 22:04:18.733659 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:18.733549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerDied","Data":"fdb8bf145ac0ed2e9bdea0643d77ba043c8fce5af544e3799155cef8d1e4041f"}
Jul 07 22:04:18.759134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:18.759100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:19.579742 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:19.579693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:19.579959 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:19.579806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:19.580036 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:19.579969    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:19.580036 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:19.580022    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls podName:96ee12d4-97f6-4312-abe7-825cc500e3fa nodeName:}" failed. No retries permitted until 2026-07-07 22:04:23.580004204 +0000 UTC m=+44.589943359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-94mjg" (UID: "96ee12d4-97f6-4312-abe7-825cc500e3fa") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:19.580381 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:19.580357    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:04:19.580482 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:19.580414    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert podName:96795654-e144-4b33-941f-108a130aeed3 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:23.580396995 +0000 UTC m=+44.590336168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nhd7r" (UID: "96795654-e144-4b33-941f-108a130aeed3") : secret "networking-console-plugin-cert" not found
Jul 07 22:04:19.680531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:19.680493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:19.680780 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:19.680760    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:04:19.680855 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:19.680785    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c74bdd4d6-xz24x: secret "image-registry-tls" not found
Jul 07 22:04:19.680855 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:19.680841    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls podName:4b338327-3e35-47fa-a01c-3015da2cc64d nodeName:}" failed. No retries permitted until 2026-07-07 22:04:23.68082271 +0000 UTC m=+44.690761889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls") pod "image-registry-7c74bdd4d6-xz24x" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d") : secret "image-registry-tls" not found
Jul 07 22:04:19.826047 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:19.826012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:19.888410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:19.888299    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:20.105395 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:20.105347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:20.165862 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:20.165778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:20.440463 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:20.440358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:20.493512 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:20.493481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:22.102157 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.102060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:22.102630 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:22.102246    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:04:22.102630 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:22.102333    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls podName:9b44371e-723d-447f-b561-b905c2c22dc2 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:30.102309596 +0000 UTC m=+51.112248755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls") pod "dns-default-8q8w4" (UID: "9b44371e-723d-447f-b561-b905c2c22dc2") : secret "dns-default-metrics-tls" not found
Jul 07 22:04:22.687247 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.687191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:22.745637 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.745606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh" event={"ID":"7e3a766e-627f-47b3-ad07-26efa6ea42c7","Type":"ContainerStarted","Data":"32e946815ea252cb4546974f397e74bfcebf3597a3d99645cc45fecf2f782873"}
Jul 07 22:04:22.749556 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.749511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" event={"ID":"556ac2bb-399c-4b5d-9ced-fc45a4a2ab08","Type":"ContainerStarted","Data":"cd64c7762fa1368fc8a10c823597a7d7376987bc1ef5b30a3be28edeae3596c2"}
Jul 07 22:04:22.751162 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.751140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65lxg" event={"ID":"5c0f4165-dc58-4c3c-a01e-c10a38f0506e","Type":"ContainerStarted","Data":"26a29983d955bb34c3f849082b7745b1d185c6027890f5ace3c254a7ada10e1b"}
Jul 07 22:04:22.752665 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.752642    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q" event={"ID":"38aa15c2-9c3e-427a-87b1-c197b5f40a60","Type":"ContainerStarted","Data":"0aeb7a7adfe9f4a60a848c93b84f6afb9d22fe58d7610e28ed18e0c1ec49b0dc"}
Jul 07 22:04:22.754253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.754226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jhlwf" event={"ID":"c4693966-f5e2-4ec8-89e0-8276685f4770","Type":"ContainerStarted","Data":"aee286f59bc772fb595b58baad62f89677839fa6f12b0d4e9e6a1f413f025651"}
Jul 07 22:04:22.763644 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.763602    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh" podStartSLOduration=2.599595516 podStartE2EDuration="7.763590063s" totalImagesPullingTime="5.163994547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:22.762396358 +0000 UTC m=+43.772335538" watchObservedRunningTime="2026-07-07 22:04:22.763590063 +0000 UTC m=+43.773529218"
Jul 07 22:04:22.768806 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.768782    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:22.780914 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.780864    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qh56q" podStartSLOduration=2.209273333 podStartE2EDuration="7.780845241s" totalImagesPullingTime="5.571571908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:22.779874258 +0000 UTC m=+43.789813436" watchObservedRunningTime="2026-07-07 22:04:22.780845241 +0000 UTC m=+43.790784422"
Jul 07 22:04:22.803908 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.803857    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pqtm2" podStartSLOduration=11.946374682 podStartE2EDuration="42.803842661s" totalImagesPullingTime="30.857467979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:22.801994795 +0000 UTC m=+43.811933975" watchObservedRunningTime="2026-07-07 22:04:22.803842661 +0000 UTC m=+43.813781817"
Jul 07 22:04:22.816596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.816555    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jhlwf" podStartSLOduration=1.869840223 podStartE2EDuration="8.816529819s" totalImagesPullingTime="6.946689596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:22.815580114 +0000 UTC m=+43.825519292" watchObservedRunningTime="2026-07-07 22:04:22.816529819 +0000 UTC m=+43.826468997"
Jul 07 22:04:22.939147 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:22.939051    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.044276 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.044238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.130814 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.130775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.146822 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.146766    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-65lxg" podStartSLOduration=3.000130624 podStartE2EDuration="8.146745644s" totalImagesPullingTime="5.14661502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:22.830843254 +0000 UTC m=+43.840782432" watchObservedRunningTime="2026-07-07 22:04:23.146745644 +0000 UTC m=+44.156684819"
Jul 07 22:04:23.147393 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.147373    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ltc46"]
Jul 07 22:04:23.152551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.152529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.154861 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.154842    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 22:04:23.154981 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.154860    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 22:04:23.154981 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.154905    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bwh5s\""
Jul 07 22:04:23.161878 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.161858    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ltc46"]
Jul 07 22:04:23.198277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.198155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.213414 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.213376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdn4g\" (UniqueName: \"kubernetes.io/projected/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-api-access-jdn4g\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.213543 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.213425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.213543 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.213452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.213543 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.213480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b04ba8b7-0260-4da4-a19c-d91873f00f5b-crio-socket\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.213636 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.213574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b04ba8b7-0260-4da4-a19c-d91873f00f5b-data-volume\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.314253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.314213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdn4g\" (UniqueName: \"kubernetes.io/projected/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-api-access-jdn4g\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.314253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.314252    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.314491 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.314269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.314491 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.314292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b04ba8b7-0260-4da4-a19c-d91873f00f5b-crio-socket\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.314491 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.314350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b04ba8b7-0260-4da4-a19c-d91873f00f5b-data-volume\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.314491 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.314377    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:23.314491 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.314398    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:04:23.314491 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.314451    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:23.814433024 +0000 UTC m=+44.824372181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:23.314491 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.314463    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b04ba8b7-0260-4da4-a19c-d91873f00f5b-crio-socket\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.314716 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.314487    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:23.814466124 +0000 UTC m=+44.824405284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : configmap "kube-rbac-proxy" not found
Jul 07 22:04:23.314752 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.314720    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b04ba8b7-0260-4da4-a19c-d91873f00f5b-data-volume\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.323892 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.323857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdn4g\" (UniqueName: \"kubernetes.io/projected/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-api-access-jdn4g\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.517316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.517283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.570531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.570495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.617329 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.617296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:23.617508 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.617389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:23.617508 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.617466    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:04:23.617508 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.617495    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:23.617657 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.617540    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert podName:96795654-e144-4b33-941f-108a130aeed3 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:31.617520366 +0000 UTC m=+52.627459521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nhd7r" (UID: "96795654-e144-4b33-941f-108a130aeed3") : secret "networking-console-plugin-cert" not found
Jul 07 22:04:23.617657 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.617560    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls podName:96ee12d4-97f6-4312-abe7-825cc500e3fa nodeName:}" failed. No retries permitted until 2026-07-07 22:04:31.617548759 +0000 UTC m=+52.627487915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-94mjg" (UID: "96ee12d4-97f6-4312-abe7-825cc500e3fa") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:23.647359 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.647333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.707558 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.707521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.718694 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.718630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:23.718840 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.718786    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:04:23.718840 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.718806    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c74bdd4d6-xz24x: secret "image-registry-tls" not found
Jul 07 22:04:23.718933 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.718872    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls podName:4b338327-3e35-47fa-a01c-3015da2cc64d nodeName:}" failed. No retries permitted until 2026-07-07 22:04:31.718853482 +0000 UTC m=+52.728792654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls") pod "image-registry-7c74bdd4d6-xz24x" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d") : secret "image-registry-tls" not found
Jul 07 22:04:23.795961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.795865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:23.819508 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.819471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.819695 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.819517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:23.819695 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.819592    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:04:23.819695 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.819640    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:23.819695 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.819660    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:24.819640811 +0000 UTC m=+45.829579967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : configmap "kube-rbac-proxy" not found
Jul 07 22:04:23.819923 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:23.819707    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:24.819688757 +0000 UTC m=+45.829627913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:23.896869 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:23.896837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:24.831845 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:24.831799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:24.831845 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:24.831840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:24.832288 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:24.831921    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:04:24.832288 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:24.831951    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:24.832288 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:24.831974    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:26.831960102 +0000 UTC m=+47.841899258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : configmap "kube-rbac-proxy" not found
Jul 07 22:04:24.832288 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:24.832004    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:26.831991245 +0000 UTC m=+47.841930402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:25.329437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:25.329410    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-st2hx_2c3ab11d-324d-413c-b281-5ccef1f98d5e/dns-node-resolver/0.log"
Jul 07 22:04:25.424318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:25.424287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:25.487186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:25.487154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:26.330387 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:26.330361    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-chd6x_0173042e-1df4-4045-a58a-eec59e695ab4/node-ca/0.log"
Jul 07 22:04:26.747918 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:26.747827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:26.848419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:26.848384    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:26.848419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:26.848418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:26.848618 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:26.848505    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:04:26.848618 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:26.848541    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:26.848618 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:26.848582    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:30.848567874 +0000 UTC m=+51.858507037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : configmap "kube-rbac-proxy" not found
Jul 07 22:04:26.848618 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:26.848598    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:30.84859158 +0000 UTC m=+51.858530736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:26.930474 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:26.930447    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jhlwf_c4693966-f5e2-4ec8-89e0-8276685f4770/serve-healthcheck-canary/0.log"
Jul 07 22:04:29.012801 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:29.012766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:29.623611 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:29.623577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:30.176159 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.176120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:30.176575 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:30.176297    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:04:30.176575 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:30.176363    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls podName:9b44371e-723d-447f-b561-b905c2c22dc2 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:46.176346253 +0000 UTC m=+67.186285409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls") pod "dns-default-8q8w4" (UID: "9b44371e-723d-447f-b561-b905c2c22dc2") : secret "dns-default-metrics-tls" not found
Jul 07 22:04:30.374341 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.374314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:30.615467 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.615437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:30.716452 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.716417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:30.816615 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.816584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:30.883295 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.883187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:30.883295 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.883245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:30.883484 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:30.883357    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:30.883484 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:30.883432    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls podName:b04ba8b7-0260-4da4-a19c-d91873f00f5b nodeName:}" failed. No retries permitted until 2026-07-07 22:04:38.883413313 +0000 UTC m=+59.893352470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ltc46" (UID: "b04ba8b7-0260-4da4-a19c-d91873f00f5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:04:30.883766 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.883747    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b04ba8b7-0260-4da4-a19c-d91873f00f5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:30.916525 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:30.916466    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:31.061844 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:31.061808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:31.690751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:31.690716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:31.691176 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:31.690792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:31.691176 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:31.690866    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:31.691176 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:31.690937    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls podName:96ee12d4-97f6-4312-abe7-825cc500e3fa nodeName:}" failed. No retries permitted until 2026-07-07 22:04:47.690922025 +0000 UTC m=+68.700861181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-94mjg" (UID: "96ee12d4-97f6-4312-abe7-825cc500e3fa") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:04:31.691176 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:31.690868    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:04:31.691176 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:31.690970    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert podName:96795654-e144-4b33-941f-108a130aeed3 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:47.690962749 +0000 UTC m=+68.700901905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nhd7r" (UID: "96795654-e144-4b33-941f-108a130aeed3") : secret "networking-console-plugin-cert" not found
Jul 07 22:04:31.791816 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:31.791784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:31.791978 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:31.791904    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:04:31.791978 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:31.791917    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c74bdd4d6-xz24x: secret "image-registry-tls" not found
Jul 07 22:04:31.791978 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:31.791967    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls podName:4b338327-3e35-47fa-a01c-3015da2cc64d nodeName:}" failed. No retries permitted until 2026-07-07 22:04:47.791950339 +0000 UTC m=+68.801889497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls") pod "image-registry-7c74bdd4d6-xz24x" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d") : secret "image-registry-tls" not found
Jul 07 22:04:32.088484 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:32.088451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:32.263001 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:32.262969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:32.656807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:32.656774    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:32.767824 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:32.767781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:32.862002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:32.861970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:33.458388 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:33.458350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:33.662432 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:33.662402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:33.764424 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:33.764390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:33.864746 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:33.864711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:33.913953 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:33.913922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:34.062969 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:34.062889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:34.265555 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:34.265527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:34.461555 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:34.461475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:34.516708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:34.516679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:34.860557 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:34.860526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:35.662628 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:35.662583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:36.056482 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:36.056452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:36.257990 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:36.257952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:36.459091 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:36.459008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:36.559855 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:36.559829    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:36.870506 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:36.870478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:37.461686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:37.461652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:37.879165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:37.879138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:37.981468 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:37.981431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.081759 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.081726    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.182520 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.182438    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.282165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.282132    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.381836 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.381794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.482540 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.482465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.583142 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.583109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.687129 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.687098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.945683 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.945652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:38.948783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.948757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:38.951125 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:38.951105    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b04ba8b7-0260-4da4-a19c-d91873f00f5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ltc46\" (UID: \"b04ba8b7-0260-4da4-a19c-d91873f00f5b\") " pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:39.045888 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:39.045850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:39.061978 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:39.061956    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ltc46"
Jul 07 22:04:39.216617 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:39.216469    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ltc46"]
Jul 07 22:04:39.219184 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:39.219154    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04ba8b7_0260_4da4_a19c_d91873f00f5b.slice/crio-3d7b4284f5868eb3a63a5c7315bedcc48331905981f3b35fa9101b91c356b70b WatchSource:0}: Error finding container 3d7b4284f5868eb3a63a5c7315bedcc48331905981f3b35fa9101b91c356b70b: Status 404 returned error can't find the container with id 3d7b4284f5868eb3a63a5c7315bedcc48331905981f3b35fa9101b91c356b70b
Jul 07 22:04:39.659692 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:39.659660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:39.789155 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:39.789112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:39.796917 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:39.796880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ltc46" event={"ID":"b04ba8b7-0260-4da4-a19c-d91873f00f5b","Type":"ContainerStarted","Data":"3d7b4284f5868eb3a63a5c7315bedcc48331905981f3b35fa9101b91c356b70b"}
Jul 07 22:04:39.937759 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:39.937669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:40.038529 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:40.038463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:40.095534 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:40.095494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:40.260920 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:40.260853    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:40.709272 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:40.709169    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9qk8"
Jul 07 22:04:40.865449 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:40.865411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:40.986250 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:40.986154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:41.086829 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:41.086796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:41.141832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:41.141801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:41.466261 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:41.466226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:43.811245 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:43.811152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ltc46" event={"ID":"b04ba8b7-0260-4da4-a19c-d91873f00f5b","Type":"ContainerStarted","Data":"717c5a1d48146045be9dfc713b1ffd51b7b8033ed66c48db1febf83bfa3a4add"}
Jul 07 22:04:43.811245 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:43.811219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ltc46" event={"ID":"b04ba8b7-0260-4da4-a19c-d91873f00f5b","Type":"ContainerStarted","Data":"19351b0ec29a2b15fab074e55c52d8a7a21d41b4568c210251a4e1686ca2d5c1"}
Jul 07 22:04:45.304649 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.304609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:45.305114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.304688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:45.306974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.306954    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 22:04:45.307741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.307722    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 22:04:45.317977 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.317937    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee6cadc3-f10f-4fb8-aeb1-600bee989f53-metrics-certs\") pod \"network-metrics-daemon-jvdtr\" (UID: \"ee6cadc3-f10f-4fb8-aeb1-600bee989f53\") " pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:45.318060 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.317998    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45732897-8b95-499a-ba59-0fa7dd838e43-original-pull-secret\") pod \"global-pull-secret-syncer-vp95t\" (UID: \"45732897-8b95-499a-ba59-0fa7dd838e43\") " pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:45.405541 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.405504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:45.408422 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.408394    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmpdq\" (UniqueName: \"kubernetes.io/projected/e9837fad-99a1-4e1b-8621-942de05c00a0-kube-api-access-gmpdq\") pod \"network-check-target-zm7dd\" (UID: \"e9837fad-99a1-4e1b-8621-942de05c00a0\") " pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:45.410670 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.410650    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hdlmc\""
Jul 07 22:04:45.415547 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.415529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vp95t"
Jul 07 22:04:45.418583 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.418564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvdtr"
Jul 07 22:04:45.423319 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.423300    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p2w6w\""
Jul 07 22:04:45.431969 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:45.431952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:46.175122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.175091    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zm7dd"]
Jul 07 22:04:46.179551 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:46.179524    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9837fad_99a1_4e1b_8621_942de05c00a0.slice/crio-33475e8cd9dae7a5c95273651a0152170dcc800eed5a72e3cc701cca302ddae7 WatchSource:0}: Error finding container 33475e8cd9dae7a5c95273651a0152170dcc800eed5a72e3cc701cca302ddae7: Status 404 returned error can't find the container with id 33475e8cd9dae7a5c95273651a0152170dcc800eed5a72e3cc701cca302ddae7
Jul 07 22:04:46.188311 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.188284    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jvdtr"]
Jul 07 22:04:46.190867 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:46.190840    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6cadc3_f10f_4fb8_aeb1_600bee989f53.slice/crio-2e0ed1990339e24edca3ff91d6957dcfc7f5b2d95c467913d9d0bcfe01279774 WatchSource:0}: Error finding container 2e0ed1990339e24edca3ff91d6957dcfc7f5b2d95c467913d9d0bcfe01279774: Status 404 returned error can't find the container with id 2e0ed1990339e24edca3ff91d6957dcfc7f5b2d95c467913d9d0bcfe01279774
Jul 07 22:04:46.203858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.203832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vp95t"]
Jul 07 22:04:46.207237 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:46.207210    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45732897_8b95_499a_ba59_0fa7dd838e43.slice/crio-4f7361f6172d7af90b16ec6f854f1bcd3a91ed7e0cb3827fe9caa75f4aacb5e5 WatchSource:0}: Error finding container 4f7361f6172d7af90b16ec6f854f1bcd3a91ed7e0cb3827fe9caa75f4aacb5e5: Status 404 returned error can't find the container with id 4f7361f6172d7af90b16ec6f854f1bcd3a91ed7e0cb3827fe9caa75f4aacb5e5
Jul 07 22:04:46.213187 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.213158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:46.215505 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.215485    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b44371e-723d-447f-b561-b905c2c22dc2-metrics-tls\") pod \"dns-default-8q8w4\" (UID: \"9b44371e-723d-447f-b561-b905c2c22dc2\") " pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:46.445682 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.445595    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kp4p7\""
Jul 07 22:04:46.454629 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.454606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:46.583245 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.583212    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8q8w4"]
Jul 07 22:04:46.586391 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:46.586367    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b44371e_723d_447f_b561_b905c2c22dc2.slice/crio-09b8904997dffd4554fc4a5673c5668e2e52cb7765c4e64af4524c1a6618cb48 WatchSource:0}: Error finding container 09b8904997dffd4554fc4a5673c5668e2e52cb7765c4e64af4524c1a6618cb48: Status 404 returned error can't find the container with id 09b8904997dffd4554fc4a5673c5668e2e52cb7765c4e64af4524c1a6618cb48
Jul 07 22:04:46.589314 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.589293    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"]
Jul 07 22:04:46.591767 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.591748    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.597083 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.597055    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 22:04:46.597189 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.597169    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 22:04:46.597269 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.597213    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 22:04:46.598131 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.598111    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 22:04:46.598241 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.598141    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 22:04:46.598241 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.598160    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 22:04:46.598625 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.598590    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 22:04:46.608805 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.608783    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"]
Jul 07 22:04:46.691174 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.691141    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c74bdd4d6-xz24x"]
Jul 07 22:04:46.692406 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:04:46.691416    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x" podUID="4b338327-3e35-47fa-a01c-3015da2cc64d"
Jul 07 22:04:46.716036 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.715934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.716036 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.716016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-hub\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.716280 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.716066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-ca\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.716280 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.716101    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nrxf\" (UniqueName: \"kubernetes.io/projected/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-kube-api-access-9nrxf\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.716280 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.716148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.716280 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.716166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.751411 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.751375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:46.817344 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.817302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nrxf\" (UniqueName: \"kubernetes.io/projected/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-kube-api-access-9nrxf\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.817534 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.817382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.817534 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.817415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.817657 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.817636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.817718 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.817695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-hub\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.817769 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.817725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-ca\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.818453 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.818423    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.825105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.821009    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.825105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.821127    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-hub\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.825105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.822219    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-ca\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.825105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.822935    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.826191 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.826165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vp95t" event={"ID":"45732897-8b95-499a-ba59-0fa7dd838e43","Type":"ContainerStarted","Data":"4f7361f6172d7af90b16ec6f854f1bcd3a91ed7e0cb3827fe9caa75f4aacb5e5"}
Jul 07 22:04:46.827786 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.827760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q8w4" event={"ID":"9b44371e-723d-447f-b561-b905c2c22dc2","Type":"ContainerStarted","Data":"09b8904997dffd4554fc4a5673c5668e2e52cb7765c4e64af4524c1a6618cb48"}
Jul 07 22:04:46.830951 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.830893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvdtr" event={"ID":"ee6cadc3-f10f-4fb8-aeb1-600bee989f53","Type":"ContainerStarted","Data":"2e0ed1990339e24edca3ff91d6957dcfc7f5b2d95c467913d9d0bcfe01279774"}
Jul 07 22:04:46.832249 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.832190    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nrxf\" (UniqueName: \"kubernetes.io/projected/8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6-kube-api-access-9nrxf\") pod \"cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b\" (UID: \"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.833674 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.833643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ltc46" event={"ID":"b04ba8b7-0260-4da4-a19c-d91873f00f5b","Type":"ContainerStarted","Data":"c16278339f58d27a26cd805f90c6b081f83c38791ba95edf04e9de4718a3b7e1"}
Jul 07 22:04:46.835673 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.835646    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:46.836260 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.836240    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zm7dd" event={"ID":"e9837fad-99a1-4e1b-8621-942de05c00a0","Type":"ContainerStarted","Data":"0792eb0479e1b4860e8ff5eec46dd2ec1dc913ad448ee524487767a293a117c2"}
Jul 07 22:04:46.836386 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.836284    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:04:46.836386 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.836306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zm7dd" event={"ID":"e9837fad-99a1-4e1b-8621-942de05c00a0","Type":"ContainerStarted","Data":"33475e8cd9dae7a5c95273651a0152170dcc800eed5a72e3cc701cca302ddae7"}
Jul 07 22:04:46.843157 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.843132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:46.848832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.848807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:46.853938 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.853104    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ltc46" podStartSLOduration=17.121284345 podStartE2EDuration="23.853090659s" totalImagesPullingTime="6.731806314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:04:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:46.8524625 +0000 UTC m=+67.862401681" watchObservedRunningTime="2026-07-07 22:04:46.853090659 +0000 UTC m=+67.863029836"
Jul 07 22:04:46.892278 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.892215    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zm7dd" podStartSLOduration=66.892178889 podStartE2EDuration="1m6.892178889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:46.89027017 +0000 UTC m=+67.900209349" watchObservedRunningTime="2026-07-07 22:04:46.892178889 +0000 UTC m=+67.902118069"
Jul 07 22:04:46.908078 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.908045    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"
Jul 07 22:04:46.918093 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.918067    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-installation-pull-secrets\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:46.918233 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.918106    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-bound-sa-token\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:46.918233 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.918153    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-image-registry-private-configuration\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:46.918233 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.918188    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-certificates\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:46.918404 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.918239    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xwxh\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-kube-api-access-6xwxh\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:46.918404 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.918265    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b338327-3e35-47fa-a01c-3015da2cc64d-ca-trust-extracted\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:46.918404 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.918316    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-trusted-ca\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:46.919072 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.919027    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b338327-3e35-47fa-a01c-3015da2cc64d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:04:46.919633 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.919495    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:04:46.919633 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.919567    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:04:46.921039 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.921016    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-kube-api-access-6xwxh" (OuterVolumeSpecName: "kube-api-access-6xwxh") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "kube-api-access-6xwxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:04:46.921154 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.921093    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:04:46.921903 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.921868    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:04:46.922882 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.922856    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:04:46.964990 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:46.964955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:47.019620 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.019580    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-trusted-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:47.019620 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.019617    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-installation-pull-secrets\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:47.019880 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.019637    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-bound-sa-token\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:47.019880 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.019650    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b338327-3e35-47fa-a01c-3015da2cc64d-image-registry-private-configuration\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:47.019880 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.019663    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-certificates\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:47.019880 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.019679    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xwxh\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-kube-api-access-6xwxh\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:47.019880 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.019695    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b338327-3e35-47fa-a01c-3015da2cc64d-ca-trust-extracted\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:47.300096 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.300065    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b"]
Jul 07 22:04:47.726369 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.726271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:47.726369 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.726351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:47.735038 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.729713    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96795654-e144-4b33-941f-108a130aeed3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nhd7r\" (UID: \"96795654-e144-4b33-941f-108a130aeed3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:47.735175 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.735090    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96ee12d4-97f6-4312-abe7-825cc500e3fa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-94mjg\" (UID: \"96ee12d4-97f6-4312-abe7-825cc500e3fa\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:47.827248 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.827190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:47.830315 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.830287    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"image-registry-7c74bdd4d6-xz24x\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") " pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:47.842071 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.842038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b" event={"ID":"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6","Type":"ContainerStarted","Data":"44deda6f353b6f6169d189cd44be74aa19a37e2a364348a54ab93f2dffe04dc4"}
Jul 07 22:04:47.844397 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.844374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c74bdd4d6-xz24x"
Jul 07 22:04:47.845146 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.845122    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvdtr" event={"ID":"ee6cadc3-f10f-4fb8-aeb1-600bee989f53","Type":"ContainerStarted","Data":"befc2e37794cf1c200e6c8632c2cda79ae37e29e5be9ab4a352629551f8eb5b3"}
Jul 07 22:04:47.845293 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.845172    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvdtr" event={"ID":"ee6cadc3-f10f-4fb8-aeb1-600bee989f53","Type":"ContainerStarted","Data":"cf420bf5693a2d0dc01d502d3ff01f3a501a898b9c6b77ac4f8ba9bcd140f202"}
Jul 07 22:04:47.864683 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.864628    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jvdtr" podStartSLOduration=66.882854824 podStartE2EDuration="1m7.864608716s" totalImagesPullingTime="981.753892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:47.863551852 +0000 UTC m=+68.873491030" watchObservedRunningTime="2026-07-07 22:04:47.864608716 +0000 UTC m=+68.874547895"
Jul 07 22:04:47.872484 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.872284    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cndbw\""
Jul 07 22:04:47.880858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.880625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"
Jul 07 22:04:47.929547 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.928330    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") pod \"4b338327-3e35-47fa-a01c-3015da2cc64d\" (UID: \"4b338327-3e35-47fa-a01c-3015da2cc64d\") "
Jul 07 22:04:47.931800 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.931773    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4b338327-3e35-47fa-a01c-3015da2cc64d" (UID: "4b338327-3e35-47fa-a01c-3015da2cc64d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:04:47.953141 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.953115    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z6wkv\""
Jul 07 22:04:47.960284 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.960255    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"
Jul 07 22:04:47.968821 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:47.968792    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:48.029648 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.029450    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b338327-3e35-47fa-a01c-3015da2cc64d-registry-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:04:48.038247 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.038220    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg"]
Jul 07 22:04:48.057450 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.057367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:48.131908 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.131781    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r"]
Jul 07 22:04:48.178214 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.178163    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c74bdd4d6-xz24x"]
Jul 07 22:04:48.182783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.182638    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c74bdd4d6-xz24x"]
Jul 07 22:04:48.656489 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.656400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:48.709190 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.709118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:48.803668 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:48.803607    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ee12d4_97f6_4312_abe7_825cc500e3fa.slice/crio-421a1df51f566485bc3a7d9750ec933412788b9f078c24c120fdb2f8634e3841 WatchSource:0}: Error finding container 421a1df51f566485bc3a7d9750ec933412788b9f078c24c120fdb2f8634e3841: Status 404 returned error can't find the container with id 421a1df51f566485bc3a7d9750ec933412788b9f078c24c120fdb2f8634e3841
Jul 07 22:04:48.804286 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:48.804260    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96795654_e144_4b33_941f_108a130aeed3.slice/crio-49a20ca9098240eea9eb8231ebd48d2b303b0c83c7903f3c705a158b7b37f01b WatchSource:0}: Error finding container 49a20ca9098240eea9eb8231ebd48d2b303b0c83c7903f3c705a158b7b37f01b: Status 404 returned error can't find the container with id 49a20ca9098240eea9eb8231ebd48d2b303b0c83c7903f3c705a158b7b37f01b
Jul 07 22:04:48.851479 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.851449    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r" event={"ID":"96795654-e144-4b33-941f-108a130aeed3","Type":"ContainerStarted","Data":"49a20ca9098240eea9eb8231ebd48d2b303b0c83c7903f3c705a158b7b37f01b"}
Jul 07 22:04:48.852877 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:48.852851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg" event={"ID":"96ee12d4-97f6-4312-abe7-825cc500e3fa","Type":"ContainerStarted","Data":"421a1df51f566485bc3a7d9750ec933412788b9f078c24c120fdb2f8634e3841"}
Jul 07 22:04:49.199618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:49.199535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:49.265890 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:49.265853    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:49.503475 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:49.503440    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b338327-3e35-47fa-a01c-3015da2cc64d" path="/var/lib/kubelet/pods/4b338327-3e35-47fa-a01c-3015da2cc64d/volumes"
Jul 07 22:04:49.862774 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:49.862665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q8w4" event={"ID":"9b44371e-723d-447f-b561-b905c2c22dc2","Type":"ContainerStarted","Data":"1271dd972efb68c00bb5847af4c0195d8312bd4987a8a4a92a9813a33b034ec8"}
Jul 07 22:04:49.863355 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:49.863331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q8w4" event={"ID":"9b44371e-723d-447f-b561-b905c2c22dc2","Type":"ContainerStarted","Data":"66c412eb9a5332405453471840d78cbd7e6ebc1a5ca3e7bd67f5e5981ba990f7"}
Jul 07 22:04:49.863466 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:49.863374    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:04:49.882418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:49.882356    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8q8w4" podStartSLOduration=33.634897632 podStartE2EDuration="35.882334592s" totalImagesPullingTime="2.24743696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:49.881441334 +0000 UTC m=+70.891380515" watchObservedRunningTime="2026-07-07 22:04:49.882334592 +0000 UTC m=+70.892273769"
Jul 07 22:04:50.764974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:50.764942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:50.822929 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:50.822892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:51.604179 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.604134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:51.607380 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.607356    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d8fd478f-v965k"]
Jul 07 22:04:51.619710 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.619688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.623290 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.623268    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 22:04:51.623502 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.623487    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 22:04:51.624306 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.624282    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 22:04:51.624412 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.624306    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 22:04:51.624589 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.624571    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 22:04:51.624640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.624604    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hd2gj\""
Jul 07 22:04:51.624702 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.624686    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 22:04:51.625318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.625298    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 22:04:51.626176 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.626155    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d8fd478f-v965k"]
Jul 07 22:04:51.682725 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.682692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:51.762459 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.762417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-oauth-config\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.762637 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.762509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-config\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.762637 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.762545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-oauth-serving-cert\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.762637 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.762575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-service-ca\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.762816 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.762652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m22vh\" (UniqueName: \"kubernetes.io/projected/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-kube-api-access-m22vh\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.762816 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.762681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-serving-cert\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.864107 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.864022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m22vh\" (UniqueName: \"kubernetes.io/projected/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-kube-api-access-m22vh\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.864107 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.864078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-serving-cert\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.864107 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.864107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-oauth-config\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.864390 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.864127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-config\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.864390 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.864143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-oauth-serving-cert\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.864390 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.864162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-service-ca\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.864898 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.864877    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-service-ca\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.866749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.866092    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-config\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.866749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.866712    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-oauth-serving-cert\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.869366 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.869342    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-serving-cert\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.870649 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.870624    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-oauth-config\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.873512 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.873487    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m22vh\" (UniqueName: \"kubernetes.io/projected/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-kube-api-access-m22vh\") pod \"console-85d8fd478f-v965k\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") " pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:51.930527 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:51.930494    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:04:53.138024 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:53.137997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d8fd478f-v965k"]
Jul 07 22:04:53.140770 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:04:53.140747    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c11cc1b_ca51_46c3_b54b_d3c2c85d1d18.slice/crio-0b2e3ad232d194a897ddaa96dea922e0f4aa692bd6d83740d6c42dd0a1ceab61 WatchSource:0}: Error finding container 0b2e3ad232d194a897ddaa96dea922e0f4aa692bd6d83740d6c42dd0a1ceab61: Status 404 returned error can't find the container with id 0b2e3ad232d194a897ddaa96dea922e0f4aa692bd6d83740d6c42dd0a1ceab61
Jul 07 22:04:53.599427 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:53.599393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:53.883125 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:53.883029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vp95t" event={"ID":"45732897-8b95-499a-ba59-0fa7dd838e43","Type":"ContainerStarted","Data":"7a5f0c503cb44bfedeac0b4d634972e2d6a6d72a1a2322be36faca4bfe33083a"}
Jul 07 22:04:53.884143 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:53.884121    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d8fd478f-v965k" event={"ID":"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18","Type":"ContainerStarted","Data":"0b2e3ad232d194a897ddaa96dea922e0f4aa692bd6d83740d6c42dd0a1ceab61"}
Jul 07 22:04:53.897494 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:53.897447    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vp95t" podStartSLOduration=67.100832713 podStartE2EDuration="1m13.897432052s" totalImagesPullingTime="6.796599339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:53.895996719 +0000 UTC m=+74.905935897" watchObservedRunningTime="2026-07-07 22:04:53.897432052 +0000 UTC m=+74.907371224"
Jul 07 22:04:54.890417 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:54.890384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r" event={"ID":"96795654-e144-4b33-941f-108a130aeed3","Type":"ContainerStarted","Data":"23272f799e4b0d54afffadf59e7451a2a1d2c5d761045685e02995e5c0d4a875"}
Jul 07 22:04:54.892275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:54.892247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg" event={"ID":"96ee12d4-97f6-4312-abe7-825cc500e3fa","Type":"ContainerStarted","Data":"3151909cfa3ce306d6fd2c35e4f293d7ec74c9e32a00dbc1adfcb2498a564654"}
Jul 07 22:04:54.894297 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:54.894270    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b" event={"ID":"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6","Type":"ContainerStarted","Data":"d977c51c4adf872364ff051738726e8e0f4b3114ccb4175e780955172b357f6e"}
Jul 07 22:04:54.894451 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:54.894316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b" event={"ID":"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6","Type":"ContainerStarted","Data":"6c7eb33e931d78e681a081c8371149041d80397bd879e6c7656e2b144743d638"}
Jul 07 22:04:54.923289 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:54.923245    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-94mjg" podStartSLOduration=34.131251093 podStartE2EDuration="39.923228342s" totalImagesPullingTime="5.791977249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:54.92255088 +0000 UTC m=+75.932490058" watchObservedRunningTime="2026-07-07 22:04:54.923228342 +0000 UTC m=+75.933167520"
Jul 07 22:04:54.923604 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:54.923578    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nhd7r" podStartSLOduration=34.130935931 podStartE2EDuration="39.923572525s" totalImagesPullingTime="5.792636594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:54.905993971 +0000 UTC m=+75.915933150" watchObservedRunningTime="2026-07-07 22:04:54.923572525 +0000 UTC m=+75.933511706"
Jul 07 22:04:54.999549 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:54.999521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:55.102047 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:55.101963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:55.195905 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:55.195869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:55.444255 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:55.444154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:55.900829 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:55.900792    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b" event={"ID":"8ed6e793-16a0-45a5-aa7c-d9f49d3c42f6","Type":"ContainerStarted","Data":"a91b2e7ab7df232e479be05b8095f7e0951e99c327bf6ad82faa17bf25d8cb05"}
Jul 07 22:04:55.917773 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:55.917713    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f4d7f95b8-cxh6b" podStartSLOduration=2.6464914569999998 podStartE2EDuration="9.917693003s" totalImagesPullingTime="7.271201546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:55.916776818 +0000 UTC m=+76.926715998" watchObservedRunningTime="2026-07-07 22:04:55.917693003 +0000 UTC m=+76.927632185"
Jul 07 22:04:57.909320 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:57.909285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d8fd478f-v965k" event={"ID":"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18","Type":"ContainerStarted","Data":"cd334e9b3445d5e9ac3d08772ea1d57ee6dbbee3bd6cc3dad692e4df4a1a27db"}
Jul 07 22:04:57.927177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:57.927130    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d8fd478f-v965k" podStartSLOduration=2.914383644 podStartE2EDuration="6.927114395s" totalImagesPullingTime="4.012730751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:57.92582075 +0000 UTC m=+78.935759932" watchObservedRunningTime="2026-07-07 22:04:57.927114395 +0000 UTC m=+78.937053573"
Jul 07 22:04:59.589278 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:59.589148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:59.643724 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:59.643694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:04:59.868614 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:04:59.868528    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8q8w4"
Jul 07 22:05:00.195178 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:00.195096    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:00.256293 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:00.256259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:00.810104 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:00.810068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:01.931108 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:01.931082    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:05:01.931520 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:01.931133    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:05:01.932501 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:01.932475    2573 patch_prober.go:28] interesting pod/console-85d8fd478f-v965k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Jul 07 22:05:01.932606 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:01.932518    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85d8fd478f-v965k" podUID="9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Jul 07 22:05:02.006732 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:02.006701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:02.064559 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:02.064523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:03.662573 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:03.662537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:03.717590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:03.717559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:04.771938 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:04.771908    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d8fd478f-v965k"]
Jul 07 22:05:06.196997 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:06.196966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:06.916732 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:06.916703    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:07.018497 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:07.018461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:07.096295 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:07.096266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:07.805927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:07.805898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:07.905470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:07.905437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:08.192312 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:08.192229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:08.293378 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:08.293337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:08.597515 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:08.597482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:08.697967 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:08.697939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:08.990901 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:08.990810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:09.091951 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:09.091924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:09.206380 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:09.206350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:09.308036 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:09.308004    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:10.186011 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:10.185979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:12.331666 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.331632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:12.522281 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.522245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:12.587892 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.587816    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6d7pt"]
Jul 07 22:05:12.614337 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.614303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:12.666528 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.666496    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.669096 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.669073    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 22:05:12.670260 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.670245    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c9wff\""
Jul 07 22:05:12.670426 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.670374    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 22:05:12.670547 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.670533    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 22:05:12.670690 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.670675    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 22:05:12.688321 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.688295    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:12.785943 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.785911    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:12.824275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824176    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-sys\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-root\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-tls\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824500 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824312    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-textfile\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824500 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bzcr\" (UniqueName: \"kubernetes.io/projected/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-kube-api-access-2bzcr\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824500 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824500 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824387    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824500 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-wtmp\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.824500 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.824472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-metrics-client-ca\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.886338 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.886266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:12.924859 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-sys\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.924984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-root\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.924984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-tls\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.924984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-textfile\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.924984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924930    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-sys\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.924984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924940    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-root\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.924984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bzcr\" (UniqueName: \"kubernetes.io/projected/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-kube-api-access-2bzcr\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.924984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.925020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.925044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-wtmp\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.925072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-metrics-client-ca\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.925216    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-wtmp\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925502 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.925297    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-textfile\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925671 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.925643    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-metrics-client-ca\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.925771 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.925756    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.927418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.927401    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.927508 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.927493    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-node-exporter-tls\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.934272 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.934252    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bzcr\" (UniqueName: \"kubernetes.io/projected/b0b4b488-5d82-4527-89f1-f6eea8acbcd7-kube-api-access-2bzcr\") pod \"node-exporter-6d7pt\" (UID: \"b0b4b488-5d82-4527-89f1-f6eea8acbcd7\") " pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:12.976459 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:12.976425    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6d7pt"
Jul 07 22:05:13.011660 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:13.011634    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:13.021025 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:05:13.020996    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b4b488_5d82_4527_89f1_f6eea8acbcd7.slice/crio-26f00dbe04743214d8b7a0f2016c9f8b20cae9d8d0f224b34c3bd01f39d5b8f9 WatchSource:0}: Error finding container 26f00dbe04743214d8b7a0f2016c9f8b20cae9d8d0f224b34c3bd01f39d5b8f9: Status 404 returned error can't find the container with id 26f00dbe04743214d8b7a0f2016c9f8b20cae9d8d0f224b34c3bd01f39d5b8f9
Jul 07 22:05:13.089549 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:13.089510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:13.531657 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:13.531621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:13.603051 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:13.603015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:13.734443 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:13.734410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:13.836030 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:13.835934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:13.962347 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:13.962213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6d7pt" event={"ID":"b0b4b488-5d82-4527-89f1-f6eea8acbcd7","Type":"ContainerStarted","Data":"26f00dbe04743214d8b7a0f2016c9f8b20cae9d8d0f224b34c3bd01f39d5b8f9"}
Jul 07 22:05:14.966987 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:14.966959    2573 generic.go:356] "Generic (PLEG): container finished" podID="b0b4b488-5d82-4527-89f1-f6eea8acbcd7" containerID="7a9220a943b80425e6cc96b14ef93bd24f9cc33d8ae048c39ef32878e0d4aeca" exitCode=0
Jul 07 22:05:14.967392 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:14.967033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6d7pt" event={"ID":"b0b4b488-5d82-4527-89f1-f6eea8acbcd7","Type":"ContainerDied","Data":"7a9220a943b80425e6cc96b14ef93bd24f9cc33d8ae048c39ef32878e0d4aeca"}
Jul 07 22:05:15.453362 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:15.453319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:15.530852 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:15.530820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:15.746567 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:15.746490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:15.972046 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:15.972013    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6d7pt" event={"ID":"b0b4b488-5d82-4527-89f1-f6eea8acbcd7","Type":"ContainerStarted","Data":"44e2cb6d681e0fe26ce62fcb2e286c2b9fa32e71e921780da8b5ffcfd84f7977"}
Jul 07 22:05:15.972443 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:15.972060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6d7pt" event={"ID":"b0b4b488-5d82-4527-89f1-f6eea8acbcd7","Type":"ContainerStarted","Data":"41f0872e714c7f397f6be6d289aa7b4685f1746586ab2c0bb1fbd85a7ab6bf08"}
Jul 07 22:05:15.993020 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:15.992969    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6d7pt" podStartSLOduration=2.978991139 podStartE2EDuration="3.992955459s" totalImagesPullingTime="940.69102ms" totalInitContainerRuntime="73.2733ms" isStatefulPod=true podCreationTimestamp="2026-07-07 22:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:05:15.991238831 +0000 UTC m=+97.001178010" watchObservedRunningTime="2026-07-07 22:05:15.992955459 +0000 UTC m=+97.002894704"
Jul 07 22:05:16.326348 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:16.326306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:16.984105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:16.984078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:17.085336 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.085306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:17.349050 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.349012    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"]
Jul 07 22:05:17.351231 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.351189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.352662 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.352640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:17.353892 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.353871    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 22:05:17.353892 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.353888    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v68fc\""
Jul 07 22:05:17.361697 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.361675    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"]
Jul 07 22:05:17.455258 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.455222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:17.465006 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.464979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce3b5bba-5377-4892-96fb-97b17f9a5315-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-d4tl5\" (UID: \"ce3b5bba-5377-4892-96fb-97b17f9a5315\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.465100 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.465051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m226g\" (UniqueName: \"kubernetes.io/projected/ce3b5bba-5377-4892-96fb-97b17f9a5315-kube-api-access-m226g\") pod \"monitoring-plugin-d5dcff7cf-d4tl5\" (UID: \"ce3b5bba-5377-4892-96fb-97b17f9a5315\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.544871 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.544835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:17.565768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.565738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce3b5bba-5377-4892-96fb-97b17f9a5315-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-d4tl5\" (UID: \"ce3b5bba-5377-4892-96fb-97b17f9a5315\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.565926 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.565800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m226g\" (UniqueName: \"kubernetes.io/projected/ce3b5bba-5377-4892-96fb-97b17f9a5315-kube-api-access-m226g\") pod \"monitoring-plugin-d5dcff7cf-d4tl5\" (UID: \"ce3b5bba-5377-4892-96fb-97b17f9a5315\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.568187 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.568162    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce3b5bba-5377-4892-96fb-97b17f9a5315-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-d4tl5\" (UID: \"ce3b5bba-5377-4892-96fb-97b17f9a5315\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.573907 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.573879    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m226g\" (UniqueName: \"kubernetes.io/projected/ce3b5bba-5377-4892-96fb-97b17f9a5315-kube-api-access-m226g\") pod \"monitoring-plugin-d5dcff7cf-d4tl5\" (UID: \"ce3b5bba-5377-4892-96fb-97b17f9a5315\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.645473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.645392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:17.660304 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.660281    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:17.788143 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.788103    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"]
Jul 07 22:05:17.790745 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:05:17.790714    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3b5bba_5377_4892_96fb_97b17f9a5315.slice/crio-aa2d96549b29364a7a2b2137e9ca2aed43c44728700620dd2af30c08ad65e29d WatchSource:0}: Error finding container aa2d96549b29364a7a2b2137e9ca2aed43c44728700620dd2af30c08ad65e29d: Status 404 returned error can't find the container with id aa2d96549b29364a7a2b2137e9ca2aed43c44728700620dd2af30c08ad65e29d
Jul 07 22:05:17.849028 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.849004    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zm7dd"
Jul 07 22:05:17.979701 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.979619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5" event={"ID":"ce3b5bba-5377-4892-96fb-97b17f9a5315","Type":"ContainerStarted","Data":"aa2d96549b29364a7a2b2137e9ca2aed43c44728700620dd2af30c08ad65e29d"}
Jul 07 22:05:17.995893 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:17.995862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:18.096953 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:18.096923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:18.715389 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:18.715358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:18.813771 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:18.813733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:19.989058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:19.988975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5" event={"ID":"ce3b5bba-5377-4892-96fb-97b17f9a5315","Type":"ContainerStarted","Data":"f9f76e4f9aa99d79a5cd818f9f0743b7f45b1fe96634443870256633fa4048f3"}
Jul 07 22:05:19.989447 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:19.989165    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:19.993689 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:19.993671    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5"
Jul 07 22:05:20.009689 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:20.009645    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d4tl5" podStartSLOduration=1.227000041 podStartE2EDuration="3.009630737s" totalImagesPullingTime="1.782630696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:05:20.008545183 +0000 UTC m=+101.018484360" watchObservedRunningTime="2026-07-07 22:05:20.009630737 +0000 UTC m=+101.019569915"
Jul 07 22:05:21.126287 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:21.126254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:21.228297 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:21.228246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:23.583549 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.583510    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f787b568-7hrdd"]
Jul 07 22:05:23.622463 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.622419    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f787b568-7hrdd"]
Jul 07 22:05:23.622620 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.622548    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.629478 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.629457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 22:05:23.716300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.716263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-trusted-ca-bundle\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.716300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.716305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhslb\" (UniqueName: \"kubernetes.io/projected/f748042e-1694-426a-a24b-436eb1dc3e5f-kube-api-access-mhslb\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.716510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.716345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-service-ca\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.716510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.716382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-oauth-config\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.716510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.716403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-oauth-serving-cert\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.716510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.716420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-console-config\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.716510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.716475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-serving-cert\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.817502 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.817460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-trusted-ca-bundle\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.817717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.817514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhslb\" (UniqueName: \"kubernetes.io/projected/f748042e-1694-426a-a24b-436eb1dc3e5f-kube-api-access-mhslb\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.817717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.817548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-service-ca\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.817717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.817579    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-oauth-config\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.817717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.817612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-oauth-serving-cert\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.817717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.817635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-console-config\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.817717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.817664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-serving-cert\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.818428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.818403    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-service-ca\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.818551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.818461    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-console-config\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.818551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.818461    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-trusted-ca-bundle\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.818748 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.818724    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-oauth-serving-cert\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.820087 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.820056    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-oauth-config\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.820275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.820257    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-serving-cert\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.828460 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.828439    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhslb\" (UniqueName: \"kubernetes.io/projected/f748042e-1694-426a-a24b-436eb1dc3e5f-kube-api-access-mhslb\") pod \"console-84f787b568-7hrdd\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") " pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:23.931351 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:23.931254    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:24.100461 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:24.100432    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f787b568-7hrdd"]
Jul 07 22:05:24.102706 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:05:24.102680    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf748042e_1694_426a_a24b_436eb1dc3e5f.slice/crio-79d58e468648927319dff0f4c77cef28ae75ff1943323917109777b871297526 WatchSource:0}: Error finding container 79d58e468648927319dff0f4c77cef28ae75ff1943323917109777b871297526: Status 404 returned error can't find the container with id 79d58e468648927319dff0f4c77cef28ae75ff1943323917109777b871297526
Jul 07 22:05:25.007504 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:25.007473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f787b568-7hrdd" event={"ID":"f748042e-1694-426a-a24b-436eb1dc3e5f","Type":"ContainerStarted","Data":"9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050"}
Jul 07 22:05:25.007962 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:25.007520    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f787b568-7hrdd" event={"ID":"f748042e-1694-426a-a24b-436eb1dc3e5f","Type":"ContainerStarted","Data":"79d58e468648927319dff0f4c77cef28ae75ff1943323917109777b871297526"}
Jul 07 22:05:25.025748 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:25.025696    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f787b568-7hrdd" podStartSLOduration=2.025680753 podStartE2EDuration="2.025680753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:05:25.024053445 +0000 UTC m=+106.033992623" watchObservedRunningTime="2026-07-07 22:05:25.025680753 +0000 UTC m=+106.035619932"
Jul 07 22:05:25.817523 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:25.817491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:25.919569 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:25.919539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:25.973794 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:25.973758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:26.047365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:26.047333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:26.147995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:26.147915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:28.018736 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:28.018703    2573 generic.go:356] "Generic (PLEG): container finished" podID="7e3a766e-627f-47b3-ad07-26efa6ea42c7" containerID="32e946815ea252cb4546974f397e74bfcebf3597a3d99645cc45fecf2f782873" exitCode=0
Jul 07 22:05:28.018736 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:28.018738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh" event={"ID":"7e3a766e-627f-47b3-ad07-26efa6ea42c7","Type":"ContainerDied","Data":"32e946815ea252cb4546974f397e74bfcebf3597a3d99645cc45fecf2f782873"}
Jul 07 22:05:28.019188 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:28.019085    2573 scope.go:117] "RemoveContainer" containerID="32e946815ea252cb4546974f397e74bfcebf3597a3d99645cc45fecf2f782873"
Jul 07 22:05:29.024924 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:29.024896    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qrpdh" event={"ID":"7e3a766e-627f-47b3-ad07-26efa6ea42c7","Type":"ContainerStarted","Data":"64e3e99bbc45e42a9dcaa1c99fa5388b3b1c26cdd52d8cebe7a4a617abe7dbe1"}
Jul 07 22:05:29.792100 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:29.792058    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85d8fd478f-v965k" podUID="9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" containerName="console" containerID="cri-o://cd334e9b3445d5e9ac3d08772ea1d57ee6dbbee3bd6cc3dad692e4df4a1a27db" gracePeriod=15
Jul 07 22:05:30.029404 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.029367    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" containerID="cd334e9b3445d5e9ac3d08772ea1d57ee6dbbee3bd6cc3dad692e4df4a1a27db" exitCode=0
Jul 07 22:05:30.029700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.029418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d8fd478f-v965k" event={"ID":"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18","Type":"ContainerDied","Data":"cd334e9b3445d5e9ac3d08772ea1d57ee6dbbee3bd6cc3dad692e4df4a1a27db"}
Jul 07 22:05:30.029700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.029461    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d8fd478f-v965k" event={"ID":"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18","Type":"ContainerDied","Data":"0b2e3ad232d194a897ddaa96dea922e0f4aa692bd6d83740d6c42dd0a1ceab61"}
Jul 07 22:05:30.029700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.029482    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b2e3ad232d194a897ddaa96dea922e0f4aa692bd6d83740d6c42dd0a1ceab61"
Jul 07 22:05:30.030597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.030583    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:05:30.056416 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056348    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-oauth-serving-cert\") pod \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") "
Jul 07 22:05:30.056416 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056379    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m22vh\" (UniqueName: \"kubernetes.io/projected/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-kube-api-access-m22vh\") pod \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") "
Jul 07 22:05:30.056416 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056407    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-oauth-config\") pod \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") "
Jul 07 22:05:30.056643 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-config\") pod \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") "
Jul 07 22:05:30.056813 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056776    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" (UID: "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:05:30.056939 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056824    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-config" (OuterVolumeSpecName: "console-config") pod "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" (UID: "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:05:30.056939 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056486    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-serving-cert\") pod \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") "
Jul 07 22:05:30.056939 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.056888    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-service-ca\") pod \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\" (UID: \"9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18\") "
Jul 07 22:05:30.057228 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.057092    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-oauth-serving-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:05:30.057228 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.057176    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-config\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:05:30.057459 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.057434    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-service-ca" (OuterVolumeSpecName: "service-ca") pod "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" (UID: "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:05:30.059014 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.058989    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" (UID: "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:05:30.059437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.059413    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" (UID: "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:05:30.059532 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.059483    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-kube-api-access-m22vh" (OuterVolumeSpecName: "kube-api-access-m22vh") pod "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" (UID: "9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18"). InnerVolumeSpecName "kube-api-access-m22vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:05:30.158316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.158285    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m22vh\" (UniqueName: \"kubernetes.io/projected/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-kube-api-access-m22vh\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:05:30.158316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.158311    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-oauth-config\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:05:30.158316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.158321    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-console-serving-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:05:30.158531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:30.158330    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:05:31.032704 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:31.032668    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d8fd478f-v965k"
Jul 07 22:05:31.051865 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:31.051840    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d8fd478f-v965k"]
Jul 07 22:05:31.056157 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:31.056124    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85d8fd478f-v965k"]
Jul 07 22:05:31.502693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:31.502657    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" path="/var/lib/kubelet/pods/9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18/volumes"
Jul 07 22:05:33.657939 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:33.657880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:33.711337 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:33.711307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:33.931829 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:33.931739    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:33.931994 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:33.931897    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:33.936354 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:33.936329    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:34.047563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:34.047535    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:05:34.193083 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:34.192999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:34.294304 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:34.294273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:34.352619 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:34.352582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:48.091639 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:48.091602    2573 generic.go:356] "Generic (PLEG): container finished" podID="5c0f4165-dc58-4c3c-a01e-c10a38f0506e" containerID="26a29983d955bb34c3f849082b7745b1d185c6027890f5ace3c254a7ada10e1b" exitCode=0
Jul 07 22:05:48.092056 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:48.091682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65lxg" event={"ID":"5c0f4165-dc58-4c3c-a01e-c10a38f0506e","Type":"ContainerDied","Data":"26a29983d955bb34c3f849082b7745b1d185c6027890f5ace3c254a7ada10e1b"}
Jul 07 22:05:48.092056 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:48.092013    2573 scope.go:117] "RemoveContainer" containerID="26a29983d955bb34c3f849082b7745b1d185c6027890f5ace3c254a7ada10e1b"
Jul 07 22:05:48.655534 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:48.655498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:48.705958 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:48.705931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:05:49.096395 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:49.096359    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65lxg" event={"ID":"5c0f4165-dc58-4c3c-a01e-c10a38f0506e","Type":"ContainerStarted","Data":"b24bd53ace7f6dd1dd051ddc95ffc67b037f19e3d3c21038dbbc83f0426d835a"}
Jul 07 22:05:52.409359 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:05:52.409324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:28.610300 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:28.610267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:28.665111 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:28.665070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:33.532783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.532709    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8586578f87-sjjk5"]
Jul 07 22:06:33.533457 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.532966    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" containerName="console"
Jul 07 22:06:33.533457 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.532980    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" containerName="console"
Jul 07 22:06:33.533457 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.533059    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c11cc1b-ca51-46c3-b54b-d3c2c85d1d18" containerName="console"
Jul 07 22:06:33.535340 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.535321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.545921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.545892    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8586578f87-sjjk5"]
Jul 07 22:06:33.590776 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.590748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:33.624869 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.624839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-serving-cert\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.624982 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.624886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-oauth-serving-cert\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.624982 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.624907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k48f\" (UniqueName: \"kubernetes.io/projected/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-kube-api-access-2k48f\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.625077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.625014    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-config\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.625077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.625042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-trusted-ca-bundle\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.625077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.625065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-service-ca\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.625190 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.625090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-oauth-config\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.644134 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.644106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:33.725839 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.725799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-config\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.725839 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.725841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-trusted-ca-bundle\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.725976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-service-ca\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-oauth-config\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-serving-cert\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726282 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-oauth-serving-cert\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726282 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k48f\" (UniqueName: \"kubernetes.io/projected/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-kube-api-access-2k48f\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726725    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-config\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726740    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-trusted-ca-bundle\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726748    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-service-ca\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.726917 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.726829    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-oauth-serving-cert\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.728750 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.728727    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-oauth-config\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.728856 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.728837    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-serving-cert\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.734049 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.734024    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k48f\" (UniqueName: \"kubernetes.io/projected/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-kube-api-access-2k48f\") pod \"console-8586578f87-sjjk5\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") " pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.844252 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.844140    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:33.989239 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:33.989185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8586578f87-sjjk5"]
Jul 07 22:06:33.992307 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:06:33.992271    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88a7d78_3b05_44aa_b1b0_a07c04f5bf75.slice/crio-1fc25b401932d492c169d06d30e05e3539e709c17765548af6ed6693069619f6 WatchSource:0}: Error finding container 1fc25b401932d492c169d06d30e05e3539e709c17765548af6ed6693069619f6: Status 404 returned error can't find the container with id 1fc25b401932d492c169d06d30e05e3539e709c17765548af6ed6693069619f6
Jul 07 22:06:34.274975 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:34.274941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8586578f87-sjjk5" event={"ID":"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75","Type":"ContainerStarted","Data":"4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328"}
Jul 07 22:06:34.275167 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:34.274997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8586578f87-sjjk5" event={"ID":"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75","Type":"ContainerStarted","Data":"1fc25b401932d492c169d06d30e05e3539e709c17765548af6ed6693069619f6"}
Jul 07 22:06:34.293630 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:34.293575    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8586578f87-sjjk5" podStartSLOduration=1.293556892 podStartE2EDuration="1.293556892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:34.2924529 +0000 UTC m=+175.302392081" watchObservedRunningTime="2026-07-07 22:06:34.293556892 +0000 UTC m=+175.303496070"
Jul 07 22:06:40.456865 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:40.456830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:40.510947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:40.510909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:43.844305 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:43.844271    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:43.844695 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:43.844323    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:43.848972 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:43.848952    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:44.320092 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:44.320065    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:06:44.370151 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:44.370115    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f787b568-7hrdd"]
Jul 07 22:06:44.459813 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:44.459773    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:44.516643 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:44.516611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:44.572267 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:44.572158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:46.115579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:46.115547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:48.663859 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:48.663830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:06:48.764513 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:06:48.764484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:07:09.391527 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.391473    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84f787b568-7hrdd" podUID="f748042e-1694-426a-a24b-436eb1dc3e5f" containerName="console" containerID="cri-o://9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050" gracePeriod=15
Jul 07 22:07:09.635553 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.635526    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:07:09.693489 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693411    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-oauth-config\") pod \"f748042e-1694-426a-a24b-436eb1dc3e5f\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") "
Jul 07 22:07:09.693489 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693472    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-oauth-serving-cert\") pod \"f748042e-1694-426a-a24b-436eb1dc3e5f\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") "
Jul 07 22:07:09.693700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693497    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-console-config\") pod \"f748042e-1694-426a-a24b-436eb1dc3e5f\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") "
Jul 07 22:07:09.693700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693536    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhslb\" (UniqueName: \"kubernetes.io/projected/f748042e-1694-426a-a24b-436eb1dc3e5f-kube-api-access-mhslb\") pod \"f748042e-1694-426a-a24b-436eb1dc3e5f\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") "
Jul 07 22:07:09.693700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693584    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-serving-cert\") pod \"f748042e-1694-426a-a24b-436eb1dc3e5f\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") "
Jul 07 22:07:09.693700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693629    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-trusted-ca-bundle\") pod \"f748042e-1694-426a-a24b-436eb1dc3e5f\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") "
Jul 07 22:07:09.693917 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693741    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-service-ca\") pod \"f748042e-1694-426a-a24b-436eb1dc3e5f\" (UID: \"f748042e-1694-426a-a24b-436eb1dc3e5f\") "
Jul 07 22:07:09.693970 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693908    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f748042e-1694-426a-a24b-436eb1dc3e5f" (UID: "f748042e-1694-426a-a24b-436eb1dc3e5f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:07:09.693970 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693931    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-console-config" (OuterVolumeSpecName: "console-config") pod "f748042e-1694-426a-a24b-436eb1dc3e5f" (UID: "f748042e-1694-426a-a24b-436eb1dc3e5f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:07:09.694065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.693973    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f748042e-1694-426a-a24b-436eb1dc3e5f" (UID: "f748042e-1694-426a-a24b-436eb1dc3e5f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:07:09.694065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.694042    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-trusted-ca-bundle\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:07:09.694065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.694060    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-oauth-serving-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:07:09.694252 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.694239    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-service-ca" (OuterVolumeSpecName: "service-ca") pod "f748042e-1694-426a-a24b-436eb1dc3e5f" (UID: "f748042e-1694-426a-a24b-436eb1dc3e5f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:07:09.694376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.694342    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-console-config\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:07:09.695722 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.695695    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f748042e-1694-426a-a24b-436eb1dc3e5f" (UID: "f748042e-1694-426a-a24b-436eb1dc3e5f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:07:09.696099 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.696073    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f748042e-1694-426a-a24b-436eb1dc3e5f" (UID: "f748042e-1694-426a-a24b-436eb1dc3e5f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:07:09.696217 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.696122    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f748042e-1694-426a-a24b-436eb1dc3e5f-kube-api-access-mhslb" (OuterVolumeSpecName: "kube-api-access-mhslb") pod "f748042e-1694-426a-a24b-436eb1dc3e5f" (UID: "f748042e-1694-426a-a24b-436eb1dc3e5f"). InnerVolumeSpecName "kube-api-access-mhslb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:07:09.795271 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.795234    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhslb\" (UniqueName: \"kubernetes.io/projected/f748042e-1694-426a-a24b-436eb1dc3e5f-kube-api-access-mhslb\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:07:09.795271 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.795265    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-serving-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:07:09.795271 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.795278    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f748042e-1694-426a-a24b-436eb1dc3e5f-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:07:09.795505 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:09.795292    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f748042e-1694-426a-a24b-436eb1dc3e5f-console-oauth-config\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:07:10.410956 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.410920    2573 generic.go:356] "Generic (PLEG): container finished" podID="f748042e-1694-426a-a24b-436eb1dc3e5f" containerID="9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050" exitCode=0
Jul 07 22:07:10.411376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.410969    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f787b568-7hrdd"
Jul 07 22:07:10.411376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.411000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f787b568-7hrdd" event={"ID":"f748042e-1694-426a-a24b-436eb1dc3e5f","Type":"ContainerDied","Data":"9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050"}
Jul 07 22:07:10.411376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.411049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f787b568-7hrdd" event={"ID":"f748042e-1694-426a-a24b-436eb1dc3e5f","Type":"ContainerDied","Data":"79d58e468648927319dff0f4c77cef28ae75ff1943323917109777b871297526"}
Jul 07 22:07:10.411376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.411069    2573 scope.go:117] "RemoveContainer" containerID="9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050"
Jul 07 22:07:10.424635 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.424611    2573 scope.go:117] "RemoveContainer" containerID="9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050"
Jul 07 22:07:10.424939 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:07:10.424920    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050\": container with ID starting with 9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050 not found: ID does not exist" containerID="9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050"
Jul 07 22:07:10.424993 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.424947    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050"} err="failed to get container status \"9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050\": rpc error: code = NotFound desc = could not find container \"9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050\": container with ID starting with 9afa930ac47c80bed5944ee2d87df9528a05ec7092ae4b2687525951cc50b050 not found: ID does not exist"
Jul 07 22:07:10.433867 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.433843    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f787b568-7hrdd"]
Jul 07 22:07:10.436964 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:10.436943    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f787b568-7hrdd"]
Jul 07 22:07:11.502439 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:11.502407    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f748042e-1694-426a-a24b-436eb1dc3e5f" path="/var/lib/kubelet/pods/f748042e-1694-426a-a24b-436eb1dc3e5f/volumes"
Jul 07 22:07:18.596448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:18.596404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:07:19.185169 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:19.185120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:07:45.322663 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:45.322628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:07:45.420326 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:07:45.420292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:11.962302 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:11.962222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:12.788414 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:12.788380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:15.377791 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:15.377756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:15.477706 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:15.477672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:16.291874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:16.291836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:16.402922 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:16.402888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:17.585751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:17.585693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:17.645754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:17.645721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:19.811890 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.811838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:19.910596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.910565    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rvzjg"]
Jul 07 22:08:19.910838 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.910825    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f748042e-1694-426a-a24b-436eb1dc3e5f" containerName="console"
Jul 07 22:08:19.910879 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.910840    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f748042e-1694-426a-a24b-436eb1dc3e5f" containerName="console"
Jul 07 22:08:19.910918 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.910896    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f748042e-1694-426a-a24b-436eb1dc3e5f" containerName="console"
Jul 07 22:08:19.913651 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.913635    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:19.914242 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.914215    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kwdv\" (UniqueName: \"kubernetes.io/projected/70564132-9202-4159-ba31-a8daf30ac217-kube-api-access-9kwdv\") pod \"cert-manager-webhook-6486ffd997-rvzjg\" (UID: \"70564132-9202-4159-ba31-a8daf30ac217\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:19.914340 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.914312    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70564132-9202-4159-ba31-a8daf30ac217-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rvzjg\" (UID: \"70564132-9202-4159-ba31-a8daf30ac217\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:19.915966 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.915946    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 22:08:19.916070 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.916034    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 22:08:19.916908 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.916896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-fcjf9\""
Jul 07 22:08:19.924319 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:19.924298    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rvzjg"]
Jul 07 22:08:20.014676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.014642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70564132-9202-4159-ba31-a8daf30ac217-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rvzjg\" (UID: \"70564132-9202-4159-ba31-a8daf30ac217\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:20.014835 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.014696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kwdv\" (UniqueName: \"kubernetes.io/projected/70564132-9202-4159-ba31-a8daf30ac217-kube-api-access-9kwdv\") pod \"cert-manager-webhook-6486ffd997-rvzjg\" (UID: \"70564132-9202-4159-ba31-a8daf30ac217\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:20.022978 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.022958    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70564132-9202-4159-ba31-a8daf30ac217-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rvzjg\" (UID: \"70564132-9202-4159-ba31-a8daf30ac217\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:20.023090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.023052    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kwdv\" (UniqueName: \"kubernetes.io/projected/70564132-9202-4159-ba31-a8daf30ac217-kube-api-access-9kwdv\") pod \"cert-manager-webhook-6486ffd997-rvzjg\" (UID: \"70564132-9202-4159-ba31-a8daf30ac217\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:20.029385 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.029356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:20.223008 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.222912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:20.351606 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.351543    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rvzjg"]
Jul 07 22:08:20.354387 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:08:20.354358    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70564132_9202_4159_ba31_a8daf30ac217.slice/crio-c6b399dd2521e2dabc5f326540604d4fc36bc55ef28d91dbf9693d17508ddcfb WatchSource:0}: Error finding container c6b399dd2521e2dabc5f326540604d4fc36bc55ef28d91dbf9693d17508ddcfb: Status 404 returned error can't find the container with id c6b399dd2521e2dabc5f326540604d4fc36bc55ef28d91dbf9693d17508ddcfb
Jul 07 22:08:20.655039 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:20.655004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg" event={"ID":"70564132-9202-4159-ba31-a8daf30ac217","Type":"ContainerStarted","Data":"c6b399dd2521e2dabc5f326540604d4fc36bc55ef28d91dbf9693d17508ddcfb"}
Jul 07 22:08:22.165637 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:22.165599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:22.266099 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:22.266063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:23.670153 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:23.670123    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg" event={"ID":"70564132-9202-4159-ba31-a8daf30ac217","Type":"ContainerStarted","Data":"b266dbc2128a8f8d4371b49fd895a59f0dfc81c423f198ca5a507950ab6e11e6"}
Jul 07 22:08:23.670590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:23.670248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:23.686227 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:23.686156    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg" podStartSLOduration=1.576922321 podStartE2EDuration="4.686139021s" totalImagesPullingTime="3.1092167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:08:23.685434167 +0000 UTC m=+284.695373344" watchObservedRunningTime="2026-07-07 22:08:23.686139021 +0000 UTC m=+284.696078201"
Jul 07 22:08:24.230397 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:24.230360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:24.329957 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:24.329914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:27.998062 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:27.998034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:28.180949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:28.180918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:28.281351 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:28.281317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:29.676015 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:29.675990    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rvzjg"
Jul 07 22:08:30.394910 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.394883    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"]
Jul 07 22:08:30.397781 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.397764    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.400235 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.400211    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:08:30.400342 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.400278    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 22:08:30.401041 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.401028    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8kj5x\""
Jul 07 22:08:30.407629 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.407607    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"]
Jul 07 22:08:30.485385 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.485347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gc2\" (UniqueName: \"kubernetes.io/projected/8f922b20-0411-4814-867c-62f499a5ba6f-kube-api-access-q9gc2\") pod \"openshift-lws-operator-fd8ccff4c-lpk8v\" (UID: \"8f922b20-0411-4814-867c-62f499a5ba6f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.485570 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.485399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f922b20-0411-4814-867c-62f499a5ba6f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpk8v\" (UID: \"8f922b20-0411-4814-867c-62f499a5ba6f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.585945 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.585907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gc2\" (UniqueName: \"kubernetes.io/projected/8f922b20-0411-4814-867c-62f499a5ba6f-kube-api-access-q9gc2\") pod \"openshift-lws-operator-fd8ccff4c-lpk8v\" (UID: \"8f922b20-0411-4814-867c-62f499a5ba6f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.586113 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.585958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f922b20-0411-4814-867c-62f499a5ba6f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpk8v\" (UID: \"8f922b20-0411-4814-867c-62f499a5ba6f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.586313 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.586297    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f922b20-0411-4814-867c-62f499a5ba6f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpk8v\" (UID: \"8f922b20-0411-4814-867c-62f499a5ba6f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.593839 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.593816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gc2\" (UniqueName: \"kubernetes.io/projected/8f922b20-0411-4814-867c-62f499a5ba6f-kube-api-access-q9gc2\") pod \"openshift-lws-operator-fd8ccff4c-lpk8v\" (UID: \"8f922b20-0411-4814-867c-62f499a5ba6f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.707167 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.707089    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"
Jul 07 22:08:30.831714 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:30.831663    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v"]
Jul 07 22:08:30.833893 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:08:30.833869    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f922b20_0411_4814_867c_62f499a5ba6f.slice/crio-a95622b1a396fb6531dd38ccce065e64c2f141ec58b4e20316ce18644b3ec794 WatchSource:0}: Error finding container a95622b1a396fb6531dd38ccce065e64c2f141ec58b4e20316ce18644b3ec794: Status 404 returned error can't find the container with id a95622b1a396fb6531dd38ccce065e64c2f141ec58b4e20316ce18644b3ec794
Jul 07 22:08:31.700911 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:31.700860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v" event={"ID":"8f922b20-0411-4814-867c-62f499a5ba6f","Type":"ContainerStarted","Data":"a95622b1a396fb6531dd38ccce065e64c2f141ec58b4e20316ce18644b3ec794"}
Jul 07 22:08:39.349945 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:39.349916    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:08:39.350809 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:39.350787    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:08:39.354346 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:39.354323    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 22:08:42.743002 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:42.742960    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v" event={"ID":"8f922b20-0411-4814-867c-62f499a5ba6f","Type":"ContainerStarted","Data":"fb6e51718fbe4598da94baf891e52967032734dc70e836e643deaa16c47d4920"}
Jul 07 22:08:42.758173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:42.758126    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpk8v" podStartSLOduration=1.8943498920000001 podStartE2EDuration="12.758111534s" totalImagesPullingTime="10.863761642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:08:42.757710764 +0000 UTC m=+303.767649941" watchObservedRunningTime="2026-07-07 22:08:42.758111534 +0000 UTC m=+303.768050711"
Jul 07 22:08:43.508318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:43.508273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:44.714062 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:44.714023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:45.740109 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:45.740035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:58.071650 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:58.071616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:58.171158 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:58.171123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:59.225207 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:59.225178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:59.325697 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:59.325664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:08:59.801028 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:08:59.800999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.119997 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.119905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.223057 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.223026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.243115 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.243089    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"]
Jul 07 22:09:00.245071 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.245056    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.247678 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.247654    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 22:09:00.247784 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.247720    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 22:09:00.248007 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.247990    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wbtfm\""
Jul 07 22:09:00.248095 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.248019    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 22:09:00.248271 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.248256    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 22:09:00.262918 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.262891    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"]
Jul 07 22:09:00.314619 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.314588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/009145dc-6fee-4808-9637-8974f7bf1ac7-manifests\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.314619 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.314620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009145dc-6fee-4808-9637-8974f7bf1ac7-tmp\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.314809 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.314693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhlxd\" (UniqueName: \"kubernetes.io/projected/009145dc-6fee-4808-9637-8974f7bf1ac7-kube-api-access-lhlxd\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.314809 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.314726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/009145dc-6fee-4808-9637-8974f7bf1ac7-webhook-cert\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.314809 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.314789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/009145dc-6fee-4808-9637-8974f7bf1ac7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.369587 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.369557    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.415206 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.415122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhlxd\" (UniqueName: \"kubernetes.io/projected/009145dc-6fee-4808-9637-8974f7bf1ac7-kube-api-access-lhlxd\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.415206 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.415154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/009145dc-6fee-4808-9637-8974f7bf1ac7-webhook-cert\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.415206 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.415176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/009145dc-6fee-4808-9637-8974f7bf1ac7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.415434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.415253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/009145dc-6fee-4808-9637-8974f7bf1ac7-manifests\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.415434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.415281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009145dc-6fee-4808-9637-8974f7bf1ac7-tmp\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.415714 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.415688    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/009145dc-6fee-4808-9637-8974f7bf1ac7-manifests\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.417665 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.417644    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009145dc-6fee-4808-9637-8974f7bf1ac7-tmp\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.417921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.417901    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/009145dc-6fee-4808-9637-8974f7bf1ac7-webhook-cert\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.417983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.417928    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/009145dc-6fee-4808-9637-8974f7bf1ac7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.423740 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.423721    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhlxd\" (UniqueName: \"kubernetes.io/projected/009145dc-6fee-4808-9637-8974f7bf1ac7-kube-api-access-lhlxd\") pod \"opendatahub-operator-controller-manager-597db99f65-gtstn\" (UID: \"009145dc-6fee-4808-9637-8974f7bf1ac7\") " pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.472077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.472049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.555164 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.555131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:00.570054 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.570026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.676638 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.676557    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.685122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.685100    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"]
Jul 07 22:09:00.687519 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:00.687492    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009145dc_6fee_4808_9637_8974f7bf1ac7.slice/crio-9e0af145acbec6dbda4f1d3f6e998f5b442e71efacc5d3ed8337901e712070d5 WatchSource:0}: Error finding container 9e0af145acbec6dbda4f1d3f6e998f5b442e71efacc5d3ed8337901e712070d5: Status 404 returned error can't find the container with id 9e0af145acbec6dbda4f1d3f6e998f5b442e71efacc5d3ed8337901e712070d5
Jul 07 22:09:00.689529 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.689509    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:09:00.735832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.735796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.800052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.800020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:00.808154 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:00.808125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn" event={"ID":"009145dc-6fee-4808-9637-8974f7bf1ac7","Type":"ContainerStarted","Data":"9e0af145acbec6dbda4f1d3f6e998f5b442e71efacc5d3ed8337901e712070d5"}
Jul 07 22:09:03.822777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:03.822745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn" event={"ID":"009145dc-6fee-4808-9637-8974f7bf1ac7","Type":"ContainerStarted","Data":"84f79c7259b238a5317bd28feb748cca435f2cb7aed01a7c80877c0280507a29"}
Jul 07 22:09:05.832378 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:05.832343    2573 generic.go:356] "Generic (PLEG): container finished" podID="009145dc-6fee-4808-9637-8974f7bf1ac7" containerID="84f79c7259b238a5317bd28feb748cca435f2cb7aed01a7c80877c0280507a29" exitCode=0
Jul 07 22:09:05.832858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:05.832423    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn" event={"ID":"009145dc-6fee-4808-9637-8974f7bf1ac7","Type":"ContainerDied","Data":"84f79c7259b238a5317bd28feb748cca435f2cb7aed01a7c80877c0280507a29"}
Jul 07 22:09:06.838168 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:06.838134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn" event={"ID":"009145dc-6fee-4808-9637-8974f7bf1ac7","Type":"ContainerStarted","Data":"f76a5d29da981b4a2cc15326c582a481927c4def4ade5062a6bc92b7984666d7"}
Jul 07 22:09:06.838558 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:06.838395    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:06.860823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:06.860778    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn" podStartSLOduration=2.36416918 podStartE2EDuration="6.860764345s" totalImagesPullingTime="3.41591092s" totalInitContainerRuntime="1.080684245s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:06.859063658 +0000 UTC m=+327.869002837" watchObservedRunningTime="2026-07-07 22:09:06.860764345 +0000 UTC m=+327.870703524"
Jul 07 22:09:12.193512 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:12.193471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:12.292077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:12.292024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:12.395613 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:12.395582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:12.497161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:12.497079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:14.325121 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:14.325089    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:14.425539 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:14.425507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:17.845370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:17.845338    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-597db99f65-gtstn"
Jul 07 22:09:19.543315 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:19.543278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:19.683841 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:19.683808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:20.224470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.224425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:20.266072 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.266035    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"]
Jul 07 22:09:20.276644 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.276605    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.280448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.280426    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 22:09:20.280568 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.280426    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 22:09:20.280782 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.280768    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 22:09:20.281224 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.281208    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 22:09:20.295632 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.295607    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"]
Jul 07 22:09:20.378431 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.378390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47dpf\" (UniqueName: \"kubernetes.io/projected/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-kube-api-access-47dpf\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.378610 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.378463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tls-certs\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.378610 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.378484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tmp\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.478965 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.478873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47dpf\" (UniqueName: \"kubernetes.io/projected/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-kube-api-access-47dpf\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.479120 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.478965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tls-certs\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.479120 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.478989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tmp\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.479120 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:20.479095    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 22:09:20.479280 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:20.479167    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tls-certs podName:79e88f6b-cd26-45f2-89c9-c04b6defd3e8 nodeName:}" failed. No retries permitted until 2026-07-07 22:09:20.979146621 +0000 UTC m=+341.989085782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tls-certs") pod "kube-auth-proxy-6b4fccd749-bk5dl" (UID: "79e88f6b-cd26-45f2-89c9-c04b6defd3e8") : secret "kube-auth-proxy-tls" not found
Jul 07 22:09:20.481277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.481253    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tmp\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.494183 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.494159    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47dpf\" (UniqueName: \"kubernetes.io/projected/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-kube-api-access-47dpf\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.560487 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.560450    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:20.635841 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.635809    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7qbxq"]
Jul 07 22:09:20.639148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.639132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:20.641791 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.641773    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 22:09:20.642034 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.642021    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zmsxf\""
Jul 07 22:09:20.655301 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.655279    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7qbxq"]
Jul 07 22:09:20.673470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.673439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:20.772567 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.772536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:20.781670 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.781644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94b8548e-7835-4a3b-a34b-5809dd1d60a6-cert\") pod \"odh-model-controller-7998c67dc4-7qbxq\" (UID: \"94b8548e-7835-4a3b-a34b-5809dd1d60a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:20.781762 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.781693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jct5q\" (UniqueName: \"kubernetes.io/projected/94b8548e-7835-4a3b-a34b-5809dd1d60a6-kube-api-access-jct5q\") pod \"odh-model-controller-7998c67dc4-7qbxq\" (UID: \"94b8548e-7835-4a3b-a34b-5809dd1d60a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:20.873909 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.873880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:20.882983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.882959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jct5q\" (UniqueName: \"kubernetes.io/projected/94b8548e-7835-4a3b-a34b-5809dd1d60a6-kube-api-access-jct5q\") pod \"odh-model-controller-7998c67dc4-7qbxq\" (UID: \"94b8548e-7835-4a3b-a34b-5809dd1d60a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:20.883077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.883040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94b8548e-7835-4a3b-a34b-5809dd1d60a6-cert\") pod \"odh-model-controller-7998c67dc4-7qbxq\" (UID: \"94b8548e-7835-4a3b-a34b-5809dd1d60a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:20.883153 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:20.883141    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 22:09:20.883237 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:20.883228    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b8548e-7835-4a3b-a34b-5809dd1d60a6-cert podName:94b8548e-7835-4a3b-a34b-5809dd1d60a6 nodeName:}" failed. No retries permitted until 2026-07-07 22:09:21.383193014 +0000 UTC m=+342.393132170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/94b8548e-7835-4a3b-a34b-5809dd1d60a6-cert") pod "odh-model-controller-7998c67dc4-7qbxq" (UID: "94b8548e-7835-4a3b-a34b-5809dd1d60a6") : secret "odh-model-controller-webhook-cert" not found
Jul 07 22:09:20.892056 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.892026    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jct5q\" (UniqueName: \"kubernetes.io/projected/94b8548e-7835-4a3b-a34b-5809dd1d60a6-kube-api-access-jct5q\") pod \"odh-model-controller-7998c67dc4-7qbxq\" (UID: \"94b8548e-7835-4a3b-a34b-5809dd1d60a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:20.983911 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.983870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tls-certs\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:20.986398 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:20.986382    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e88f6b-cd26-45f2-89c9-c04b6defd3e8-tls-certs\") pod \"kube-auth-proxy-6b4fccd749-bk5dl\" (UID: \"79e88f6b-cd26-45f2-89c9-c04b6defd3e8\") " pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:21.116251 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.116123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:21.186755 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.186721    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"
Jul 07 22:09:21.322056 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.322012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl"]
Jul 07 22:09:21.324160 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:21.324134    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e88f6b_cd26_45f2_89c9_c04b6defd3e8.slice/crio-369a260b5257c8543fd34524df66130480b63fb385463b0a2a8698b6835e60f7 WatchSource:0}: Error finding container 369a260b5257c8543fd34524df66130480b63fb385463b0a2a8698b6835e60f7: Status 404 returned error can't find the container with id 369a260b5257c8543fd34524df66130480b63fb385463b0a2a8698b6835e60f7
Jul 07 22:09:21.385410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.385328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:21.388217 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.388175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94b8548e-7835-4a3b-a34b-5809dd1d60a6-cert\") pod \"odh-model-controller-7998c67dc4-7qbxq\" (UID: \"94b8548e-7835-4a3b-a34b-5809dd1d60a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:21.390685 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.390667    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94b8548e-7835-4a3b-a34b-5809dd1d60a6-cert\") pod \"odh-model-controller-7998c67dc4-7qbxq\" (UID: \"94b8548e-7835-4a3b-a34b-5809dd1d60a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:21.510128 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.510102    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g9b7j"]
Jul 07 22:09:21.514412 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.514396    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.516922 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.516899    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 22:09:21.517016 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.516929    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jvk7x\""
Jul 07 22:09:21.526293 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.526271    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g9b7j"]
Jul 07 22:09:21.549662 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.549630    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:21.590141 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.590107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smxk4\" (UniqueName: \"kubernetes.io/projected/fd6f1e60-e28b-422f-ac08-6b63e1d0d344-kube-api-access-smxk4\") pod \"model-serving-api-54d89bd5fc-g9b7j\" (UID: \"fd6f1e60-e28b-422f-ac08-6b63e1d0d344\") " pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.590141 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.590150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd6f1e60-e28b-422f-ac08-6b63e1d0d344-tls-certs\") pod \"model-serving-api-54d89bd5fc-g9b7j\" (UID: \"fd6f1e60-e28b-422f-ac08-6b63e1d0d344\") " pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.691186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.691160    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7qbxq"]
Jul 07 22:09:21.691479 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.691457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smxk4\" (UniqueName: \"kubernetes.io/projected/fd6f1e60-e28b-422f-ac08-6b63e1d0d344-kube-api-access-smxk4\") pod \"model-serving-api-54d89bd5fc-g9b7j\" (UID: \"fd6f1e60-e28b-422f-ac08-6b63e1d0d344\") " pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.691515 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.691493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd6f1e60-e28b-422f-ac08-6b63e1d0d344-tls-certs\") pod \"model-serving-api-54d89bd5fc-g9b7j\" (UID: \"fd6f1e60-e28b-422f-ac08-6b63e1d0d344\") " pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.693778 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:21.693260    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b8548e_7835_4a3b_a34b_5809dd1d60a6.slice/crio-7910ad438b5d30750a2ba1e8d30c8f06abea1c5f2ec86b99177dd7b0a6951206 WatchSource:0}: Error finding container 7910ad438b5d30750a2ba1e8d30c8f06abea1c5f2ec86b99177dd7b0a6951206: Status 404 returned error can't find the container with id 7910ad438b5d30750a2ba1e8d30c8f06abea1c5f2ec86b99177dd7b0a6951206
Jul 07 22:09:21.696133 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.696111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd6f1e60-e28b-422f-ac08-6b63e1d0d344-tls-certs\") pod \"model-serving-api-54d89bd5fc-g9b7j\" (UID: \"fd6f1e60-e28b-422f-ac08-6b63e1d0d344\") " pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.706165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.706145    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smxk4\" (UniqueName: \"kubernetes.io/projected/fd6f1e60-e28b-422f-ac08-6b63e1d0d344-kube-api-access-smxk4\") pod \"model-serving-api-54d89bd5fc-g9b7j\" (UID: \"fd6f1e60-e28b-422f-ac08-6b63e1d0d344\") " pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.709972 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.709942    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"]
Jul 07 22:09:21.712401 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.712380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:21.714420 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.714405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.716868 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.716853    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 22:09:21.716961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.716872    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 22:09:21.716961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.716890    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 22:09:21.716961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.716906    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 22:09:21.716961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.716872    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gtmw7\""
Jul 07 22:09:21.725314 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.725295    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"]
Jul 07 22:09:21.776684 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.776649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:21.791993 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.791968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-token\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.792096 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.792034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.792096 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.792071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6021dd66-c742-4f2b-87e2-31d47bd3c276-local-certs\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.792167 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.792098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.792167 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.792137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-cacerts\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.792278 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.792176    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h75st\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-kube-api-access-h75st\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.792278 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.792229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.824189 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.824160    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:21.892945 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.892909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.893097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.892959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6021dd66-c742-4f2b-87e2-31d47bd3c276-local-certs\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.893097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.893001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.893097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.893032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-cacerts\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.893097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.893078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h75st\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-kube-api-access-h75st\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.893343 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.893104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.893343 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.893137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-token\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.894127 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.894097    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.897176 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.897156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6021dd66-c742-4f2b-87e2-31d47bd3c276-local-certs\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.897682 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.897657    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-cacerts\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.898444 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.897946    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.898681 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.898662    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.902755 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.902717    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-token\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.903863 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.903837    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h75st\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-kube-api-access-h75st\") pod \"istiod-openshift-gateway-7574459656-fgzhw\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:21.906774 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.906574    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq" event={"ID":"94b8548e-7835-4a3b-a34b-5809dd1d60a6","Type":"ContainerStarted","Data":"7910ad438b5d30750a2ba1e8d30c8f06abea1c5f2ec86b99177dd7b0a6951206"}
Jul 07 22:09:21.908025 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.908002    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl" event={"ID":"79e88f6b-cd26-45f2-89c9-c04b6defd3e8","Type":"ContainerStarted","Data":"369a260b5257c8543fd34524df66130480b63fb385463b0a2a8698b6835e60f7"}
Jul 07 22:09:21.977544 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:21.977515    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g9b7j"]
Jul 07 22:09:21.980323 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:21.980291    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6f1e60_e28b_422f_ac08_6b63e1d0d344.slice/crio-38d26d4eb209debc38d4d6a6ad7860f0890e09b43bbae25486659cf07712205c WatchSource:0}: Error finding container 38d26d4eb209debc38d4d6a6ad7860f0890e09b43bbae25486659cf07712205c: Status 404 returned error can't find the container with id 38d26d4eb209debc38d4d6a6ad7860f0890e09b43bbae25486659cf07712205c
Jul 07 22:09:22.023997 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:22.023968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:22.169543 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:22.169521    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"]
Jul 07 22:09:22.171633 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:22.171611    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6021dd66_c742_4f2b_87e2_31d47bd3c276.slice/crio-35c7a4a92671c21efa0a13dca5c88c01171d1fe8dab025b7225c3fe1d5a7a50a WatchSource:0}: Error finding container 35c7a4a92671c21efa0a13dca5c88c01171d1fe8dab025b7225c3fe1d5a7a50a: Status 404 returned error can't find the container with id 35c7a4a92671c21efa0a13dca5c88c01171d1fe8dab025b7225c3fe1d5a7a50a
Jul 07 22:09:22.617593 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:22.617518    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:22.917268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:22.916965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw" event={"ID":"6021dd66-c742-4f2b-87e2-31d47bd3c276","Type":"ContainerStarted","Data":"35c7a4a92671c21efa0a13dca5c88c01171d1fe8dab025b7225c3fe1d5a7a50a"}
Jul 07 22:09:22.920013 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:22.919941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j" event={"ID":"fd6f1e60-e28b-422f-ac08-6b63e1d0d344","Type":"ContainerStarted","Data":"38d26d4eb209debc38d4d6a6ad7860f0890e09b43bbae25486659cf07712205c"}
Jul 07 22:09:26.745105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.745072    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:26.745599 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.745131    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:26.939788 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.939754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq" event={"ID":"94b8548e-7835-4a3b-a34b-5809dd1d60a6","Type":"ContainerStarted","Data":"8b7508043d1402db66feb8e6c0fe7ec848f27ff81ede8d037488db8efec63ac9"}
Jul 07 22:09:26.939949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.939862    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:26.941287 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.941262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw" event={"ID":"6021dd66-c742-4f2b-87e2-31d47bd3c276","Type":"ContainerStarted","Data":"1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39"}
Jul 07 22:09:26.941449 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.941370    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:26.942600 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.942580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl" event={"ID":"79e88f6b-cd26-45f2-89c9-c04b6defd3e8","Type":"ContainerStarted","Data":"8c1b8557940c032c93678a6a11d1add5b8bdb983c8534bf437d8370459f5c1ad"}
Jul 07 22:09:26.943934 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.943915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j" event={"ID":"fd6f1e60-e28b-422f-ac08-6b63e1d0d344","Type":"ContainerStarted","Data":"3d71c0e4df60820906b6646215cf70a5b6971055eb686cf89ae15dcef023e147"}
Jul 07 22:09:26.944053 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.944039    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:26.966183 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.966090    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq" podStartSLOduration=1.922226201 podStartE2EDuration="6.966078214s" totalImagesPullingTime="5.043852013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:26.964667258 +0000 UTC m=+347.974606440" watchObservedRunningTime="2026-07-07 22:09:26.966078214 +0000 UTC m=+347.976017370"
Jul 07 22:09:26.985346 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:26.985301    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b4fccd749-bk5dl" podStartSLOduration=1.5728556500000002 podStartE2EDuration="6.985286344s" totalImagesPullingTime="5.412430694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:26.98301798 +0000 UTC m=+347.992957159" watchObservedRunningTime="2026-07-07 22:09:26.985286344 +0000 UTC m=+347.995225909"
Jul 07 22:09:27.015277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.015227    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw" podStartSLOduration=1.443830838 podStartE2EDuration="6.015186951s" totalImagesPullingTime="4.571356113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:27.013749025 +0000 UTC m=+348.023688200" watchObservedRunningTime="2026-07-07 22:09:27.015186951 +0000 UTC m=+348.025126107"
Jul 07 22:09:27.044590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.044530    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j" podStartSLOduration=1.288537241 podStartE2EDuration="6.044504822s" totalImagesPullingTime="4.755967581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:27.041936939 +0000 UTC m=+348.051876117" watchObservedRunningTime="2026-07-07 22:09:27.044504822 +0000 UTC m=+348.054444000"
Jul 07 22:09:27.551807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.551769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:27.651177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.651145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:27.875540 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.875466    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"]
Jul 07 22:09:27.878655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.878641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:27.882029 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.882007    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nv5vd\""
Jul 07 22:09:27.893989 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.893970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:27.910784 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.910756    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"]
Jul 07 22:09:27.950363 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.950339    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:27.982410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.982381    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"]
Jul 07 22:09:27.985768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:27.985752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.007156 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.007130    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"]
Jul 07 22:09:28.049880 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.049847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.049891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.050002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.050022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.050038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050309 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.050075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050367 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.050318    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050416 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.050400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.050468 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.050435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp4x4\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-kube-api-access-rp4x4\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.062224 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.062184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:28.147702 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.147626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:28.151494 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151614 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.151614 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151614 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.151717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.151717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.151717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151774    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vmtn\" (UniqueName: \"kubernetes.io/projected/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-kube-api-access-2vmtn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.151930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.151930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151856    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.151930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.151930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp4x4\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-kube-api-access-rp4x4\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.152279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.152279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.152279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.151975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.152279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.152037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.152279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.152060    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.152279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.152144    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.152528 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.152496    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.154039 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.154013    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.154544 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.154527    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.162181 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.161899    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.169812 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.169785    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp4x4\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-kube-api-access-rp4x4\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.188993 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.188966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:28.252811 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.252776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.252949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.252831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vmtn\" (UniqueName: \"kubernetes.io/projected/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-kube-api-access-2vmtn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.252949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.252888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.253058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.252960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.253058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.252993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.253058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.253045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.253210 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.253074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.253210 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.253115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.253210 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.253137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.254156 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.253634    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.254156 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.253686    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.254156 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.253718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.254156 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.254131    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.254470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.254250    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.257014 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.256968    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.257326 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.257302    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.264587 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.264551    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vmtn\" (UniqueName: \"kubernetes.io/projected/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-kube-api-access-2vmtn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.265998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.265977    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2307f1e-822e-4ec5-a8c0-501aa4b584b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dc46s\" (UID: \"c2307f1e-822e-4ec5-a8c0-501aa4b584b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.296734 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.296700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:28.330652 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.330624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"]
Jul 07 22:09:28.332754 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:28.332728    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5234fc5f_2dfa_4752_ada5_a3eaf8d038f8.slice/crio-96773f29c6a503b1906e88015c0d4b04a7002f9c34db80c71246c9846a52d98d WatchSource:0}: Error finding container 96773f29c6a503b1906e88015c0d4b04a7002f9c34db80c71246c9846a52d98d: Status 404 returned error can't find the container with id 96773f29c6a503b1906e88015c0d4b04a7002f9c34db80c71246c9846a52d98d
Jul 07 22:09:28.436756 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.436730    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"]
Jul 07 22:09:28.438583 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:28.438559    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2307f1e_822e_4ec5_a8c0_501aa4b584b0.slice/crio-c20f1039b103a73d1bcc3bfe3ad989495f38ab2006d5f4429be34ee14b83993d WatchSource:0}: Error finding container c20f1039b103a73d1bcc3bfe3ad989495f38ab2006d5f4429be34ee14b83993d: Status 404 returned error can't find the container with id c20f1039b103a73d1bcc3bfe3ad989495f38ab2006d5f4429be34ee14b83993d
Jul 07 22:09:28.955969 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.955925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s" event={"ID":"c2307f1e-822e-4ec5-a8c0-501aa4b584b0","Type":"ContainerStarted","Data":"c20f1039b103a73d1bcc3bfe3ad989495f38ab2006d5f4429be34ee14b83993d"}
Jul 07 22:09:28.957731 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:28.957698    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" event={"ID":"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8","Type":"ContainerStarted","Data":"96773f29c6a503b1906e88015c0d4b04a7002f9c34db80c71246c9846a52d98d"}
Jul 07 22:09:30.797914 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.797874    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:30.798395 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.797952    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:30.798395 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.797981    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:30.805026 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.804994    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:30.805094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.805078    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:30.805135 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.805121    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:09:30.814236 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.814171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:30.930810 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.930686    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"]
Jul 07 22:09:30.934402 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.934379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:30.937392 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.937352    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 22:09:30.937780 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.937763    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-s75bj\""
Jul 07 22:09:30.970084 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.970048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" event={"ID":"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8","Type":"ContainerStarted","Data":"87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54"}
Jul 07 22:09:30.972027 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.971984    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s" event={"ID":"c2307f1e-822e-4ec5-a8c0-501aa4b584b0","Type":"ContainerStarted","Data":"b5bd6e8a5375f63a852ab5bcd22782fbd180f16101381be22f72e9a1379ec2b2"}
Jul 07 22:09:30.974296 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.974273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:30.979370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.979350    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"]
Jul 07 22:09:30.985254 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.985232    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"]
Jul 07 22:09:30.988756 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.988737    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:30.995445 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.995424    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 22:09:30.995761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:30.995734    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n2fkc\""
Jul 07 22:09:31.019371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.019332    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"]
Jul 07 22:09:31.080667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.080583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f175459-330e-4d31-aa64-2d8951b9c15b-cert\") pod \"kserve-controller-manager-d6f4b65b8-lk5d2\" (UID: \"3f175459-330e-4d31-aa64-2d8951b9c15b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:31.080667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.080658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hsrd\" (UniqueName: \"kubernetes.io/projected/3f175459-330e-4d31-aa64-2d8951b9c15b-kube-api-access-6hsrd\") pod \"kserve-controller-manager-d6f4b65b8-lk5d2\" (UID: \"3f175459-330e-4d31-aa64-2d8951b9c15b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:31.165032 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.164984    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" podStartSLOduration=1.702072856 podStartE2EDuration="4.164969944s" totalImagesPullingTime="2.462897088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:31.163999079 +0000 UTC m=+352.173938256" watchObservedRunningTime="2026-07-07 22:09:31.164969944 +0000 UTC m=+352.174909122"
Jul 07 22:09:31.182031 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.182001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f175459-330e-4d31-aa64-2d8951b9c15b-cert\") pod \"kserve-controller-manager-d6f4b65b8-lk5d2\" (UID: \"3f175459-330e-4d31-aa64-2d8951b9c15b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:31.182169 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.182051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hsrd\" (UniqueName: \"kubernetes.io/projected/3f175459-330e-4d31-aa64-2d8951b9c15b-kube-api-access-6hsrd\") pod \"kserve-controller-manager-d6f4b65b8-lk5d2\" (UID: \"3f175459-330e-4d31-aa64-2d8951b9c15b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:31.182278 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.182243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d25pr\" (UniqueName: \"kubernetes.io/projected/0f67602f-c33f-47f1-bfb5-90a511b13cc4-kube-api-access-d25pr\") pod \"llmisvc-controller-manager-777c6bd7d5-c5hxx\" (UID: \"0f67602f-c33f-47f1-bfb5-90a511b13cc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.182401 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.182357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f67602f-c33f-47f1-bfb5-90a511b13cc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c5hxx\" (UID: \"0f67602f-c33f-47f1-bfb5-90a511b13cc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.184691 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.184669    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f175459-330e-4d31-aa64-2d8951b9c15b-cert\") pod \"kserve-controller-manager-d6f4b65b8-lk5d2\" (UID: \"3f175459-330e-4d31-aa64-2d8951b9c15b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:31.189486 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.189465    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:31.190996 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.190974    2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 07 22:09:31.191112 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.191059    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 07 22:09:31.216369 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.216344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hsrd\" (UniqueName: \"kubernetes.io/projected/3f175459-330e-4d31-aa64-2d8951b9c15b-kube-api-access-6hsrd\") pod \"kserve-controller-manager-d6f4b65b8-lk5d2\" (UID: \"3f175459-330e-4d31-aa64-2d8951b9c15b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:31.237742 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.237679    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s" podStartSLOduration=1.873560414 podStartE2EDuration="4.237661382s" totalImagesPullingTime="2.364100968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:31.228690665 +0000 UTC m=+352.238629843" watchObservedRunningTime="2026-07-07 22:09:31.237661382 +0000 UTC m=+352.247600561"
Jul 07 22:09:31.247741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.247710    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:31.255919 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.255879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:31.283144 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.283110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f67602f-c33f-47f1-bfb5-90a511b13cc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c5hxx\" (UID: \"0f67602f-c33f-47f1-bfb5-90a511b13cc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.283320 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.283177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d25pr\" (UniqueName: \"kubernetes.io/projected/0f67602f-c33f-47f1-bfb5-90a511b13cc4-kube-api-access-d25pr\") pod \"llmisvc-controller-manager-777c6bd7d5-c5hxx\" (UID: \"0f67602f-c33f-47f1-bfb5-90a511b13cc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.283320 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:31.283281    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 22:09:31.283411 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:31.283351    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f67602f-c33f-47f1-bfb5-90a511b13cc4-cert podName:0f67602f-c33f-47f1-bfb5-90a511b13cc4 nodeName:}" failed. No retries permitted until 2026-07-07 22:09:31.783332464 +0000 UTC m=+352.793271626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f67602f-c33f-47f1-bfb5-90a511b13cc4-cert") pod "llmisvc-controller-manager-777c6bd7d5-c5hxx" (UID: "0f67602f-c33f-47f1-bfb5-90a511b13cc4") : secret "llmisvc-webhook-server-cert" not found
Jul 07 22:09:31.297944 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.297907    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:31.299078 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.299053    2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf4dc46s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 07 22:09:31.299269 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.299106    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s" podUID="c2307f1e-822e-4ec5-a8c0-501aa4b584b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 07 22:09:31.302642 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.302616    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d25pr\" (UniqueName: \"kubernetes.io/projected/0f67602f-c33f-47f1-bfb5-90a511b13cc4-kube-api-access-d25pr\") pod \"llmisvc-controller-manager-777c6bd7d5-c5hxx\" (UID: \"0f67602f-c33f-47f1-bfb5-90a511b13cc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.393968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.393945    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"]
Jul 07 22:09:31.396189 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:31.396165    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f175459_330e_4d31_aa64_2d8951b9c15b.slice/crio-604a6f822e808ff5c089d676898c88faf25b2367112b30a283980b0bd7eca7ee WatchSource:0}: Error finding container 604a6f822e808ff5c089d676898c88faf25b2367112b30a283980b0bd7eca7ee: Status 404 returned error can't find the container with id 604a6f822e808ff5c089d676898c88faf25b2367112b30a283980b0bd7eca7ee
Jul 07 22:09:31.496938 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.496905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:31.786828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.786793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f67602f-c33f-47f1-bfb5-90a511b13cc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c5hxx\" (UID: \"0f67602f-c33f-47f1-bfb5-90a511b13cc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.789264 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.789233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f67602f-c33f-47f1-bfb5-90a511b13cc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c5hxx\" (UID: \"0f67602f-c33f-47f1-bfb5-90a511b13cc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.899830 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.899800    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:31.978107 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:31.978065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2" event={"ID":"3f175459-330e-4d31-aa64-2d8951b9c15b","Type":"ContainerStarted","Data":"604a6f822e808ff5c089d676898c88faf25b2367112b30a283980b0bd7eca7ee"}
Jul 07 22:09:32.031379 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.031345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"]
Jul 07 22:09:32.035067 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:09:32.035040    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f67602f_c33f_47f1_bfb5_90a511b13cc4.slice/crio-9678191c46304fc471a086cb954c0d5c37128197b65670638dc7c12dcd6f726e WatchSource:0}: Error finding container 9678191c46304fc471a086cb954c0d5c37128197b65670638dc7c12dcd6f726e: Status 404 returned error can't find the container with id 9678191c46304fc471a086cb954c0d5c37128197b65670638dc7c12dcd6f726e
Jul 07 22:09:32.190448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.190410    2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 07 22:09:32.190638 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.190475    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 07 22:09:32.301329 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.301235    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:32.378216 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.378159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:32.387414 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.387374    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"]
Jul 07 22:09:32.387601 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.387577    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw" podUID="6021dd66-c742-4f2b-87e2-31d47bd3c276" containerName="discovery" containerID="cri-o://1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39" gracePeriod=30
Jul 07 22:09:32.467238 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.467191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:32.534983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.534915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:32.650799 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.650773    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:32.796401 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.796369    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-token\") pod \"6021dd66-c742-4f2b-87e2-31d47bd3c276\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") "
Jul 07 22:09:32.796401 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.796409    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-kubeconfig\") pod \"6021dd66-c742-4f2b-87e2-31d47bd3c276\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") "
Jul 07 22:09:32.796596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.796428    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-dns-cert\") pod \"6021dd66-c742-4f2b-87e2-31d47bd3c276\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") "
Jul 07 22:09:32.796596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.796474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6021dd66-c742-4f2b-87e2-31d47bd3c276-local-certs\") pod \"6021dd66-c742-4f2b-87e2-31d47bd3c276\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") "
Jul 07 22:09:32.796596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.796499    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h75st\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-kube-api-access-h75st\") pod \"6021dd66-c742-4f2b-87e2-31d47bd3c276\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") "
Jul 07 22:09:32.796596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.796542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-cacerts\") pod \"6021dd66-c742-4f2b-87e2-31d47bd3c276\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") "
Jul 07 22:09:32.796596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.796578    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-ca-configmap\") pod \"6021dd66-c742-4f2b-87e2-31d47bd3c276\" (UID: \"6021dd66-c742-4f2b-87e2-31d47bd3c276\") "
Jul 07 22:09:32.797448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.797382    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6021dd66-c742-4f2b-87e2-31d47bd3c276" (UID: "6021dd66-c742-4f2b-87e2-31d47bd3c276"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:09:32.799464 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.799422    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6021dd66-c742-4f2b-87e2-31d47bd3c276" (UID: "6021dd66-c742-4f2b-87e2-31d47bd3c276"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:09:32.799464 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.799443    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-token" (OuterVolumeSpecName: "istio-token") pod "6021dd66-c742-4f2b-87e2-31d47bd3c276" (UID: "6021dd66-c742-4f2b-87e2-31d47bd3c276"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:09:32.799649 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.799517    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-cacerts" (OuterVolumeSpecName: "cacerts") pod "6021dd66-c742-4f2b-87e2-31d47bd3c276" (UID: "6021dd66-c742-4f2b-87e2-31d47bd3c276"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:09:32.799649 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.799608    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6021dd66-c742-4f2b-87e2-31d47bd3c276-local-certs" (OuterVolumeSpecName: "local-certs") pod "6021dd66-c742-4f2b-87e2-31d47bd3c276" (UID: "6021dd66-c742-4f2b-87e2-31d47bd3c276"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:09:32.799728 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.799658    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-kube-api-access-h75st" (OuterVolumeSpecName: "kube-api-access-h75st") pod "6021dd66-c742-4f2b-87e2-31d47bd3c276" (UID: "6021dd66-c742-4f2b-87e2-31d47bd3c276"). InnerVolumeSpecName "kube-api-access-h75st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:09:32.799728 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.799717    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6021dd66-c742-4f2b-87e2-31d47bd3c276" (UID: "6021dd66-c742-4f2b-87e2-31d47bd3c276"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:09:32.897636 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.897598    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-token\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:32.897636 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.897634    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-kubeconfig\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:32.897636 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.897643    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-dns-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:32.897870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.897651    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6021dd66-c742-4f2b-87e2-31d47bd3c276-local-certs\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:32.897870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.897660    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h75st\" (UniqueName: \"kubernetes.io/projected/6021dd66-c742-4f2b-87e2-31d47bd3c276-kube-api-access-h75st\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:32.897870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.897668    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6021dd66-c742-4f2b-87e2-31d47bd3c276-cacerts\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:32.897870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.897676    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6021dd66-c742-4f2b-87e2-31d47bd3c276-istio-csr-ca-configmap\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:32.984082 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.984048    2573 generic.go:356] "Generic (PLEG): container finished" podID="6021dd66-c742-4f2b-87e2-31d47bd3c276" containerID="1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39" exitCode=0
Jul 07 22:09:32.984550 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.984094    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"
Jul 07 22:09:32.984550 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.984137    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw" event={"ID":"6021dd66-c742-4f2b-87e2-31d47bd3c276","Type":"ContainerDied","Data":"1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39"}
Jul 07 22:09:32.984550 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.984209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw" event={"ID":"6021dd66-c742-4f2b-87e2-31d47bd3c276","Type":"ContainerDied","Data":"35c7a4a92671c21efa0a13dca5c88c01171d1fe8dab025b7225c3fe1d5a7a50a"}
Jul 07 22:09:32.984550 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.984236    2573 scope.go:117] "RemoveContainer" containerID="1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39"
Jul 07 22:09:32.985762 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.985403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx" event={"ID":"0f67602f-c33f-47f1-bfb5-90a511b13cc4","Type":"ContainerStarted","Data":"9678191c46304fc471a086cb954c0d5c37128197b65670638dc7c12dcd6f726e"}
Jul 07 22:09:32.985893 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.985877    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:32.986851 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:32.986836    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dc46s"
Jul 07 22:09:33.032271 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.032112    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"]
Jul 07 22:09:33.043257 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.043185    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fgzhw"]
Jul 07 22:09:33.051112 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.051083    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"]
Jul 07 22:09:33.144894 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.144870    2573 scope.go:117] "RemoveContainer" containerID="1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39"
Jul 07 22:09:33.145375 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:33.145342    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39\": container with ID starting with 1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39 not found: ID does not exist" containerID="1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39"
Jul 07 22:09:33.145480 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.145387    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39"} err="failed to get container status \"1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39\": rpc error: code = NotFound desc = could not find container \"1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39\": container with ID starting with 1e6a91662ad9291417f8f09cd6a986be04d9c2e386cae86e6c62553928828f39 not found: ID does not exist"
Jul 07 22:09:33.189819 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.189785    2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 07 22:09:33.189964 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.189867    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 07 22:09:33.503276 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.503246    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6021dd66-c742-4f2b-87e2-31d47bd3c276" path="/var/lib/kubelet/pods/6021dd66-c742-4f2b-87e2-31d47bd3c276/volumes"
Jul 07 22:09:33.991885 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:33.991791    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerName="istio-proxy" containerID="cri-o://87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54" gracePeriod=30
Jul 07 22:09:35.000065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:35.000013    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2" event={"ID":"3f175459-330e-4d31-aa64-2d8951b9c15b","Type":"ContainerStarted","Data":"ec7daeba05556dd074ea8b3128149377d9ea0dbebdb88f87fc84c69b3c9216e5"}
Jul 07 22:09:35.000496 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:35.000283    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:09:35.018846 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:35.018796    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2" podStartSLOduration=2.088944341 podStartE2EDuration="5.018777526s" totalImagesPullingTime="2.929833185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:35.017547284 +0000 UTC m=+356.027486466" watchObservedRunningTime="2026-07-07 22:09:35.018777526 +0000 UTC m=+356.028716704"
Jul 07 22:09:36.006130 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:36.006095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx" event={"ID":"0f67602f-c33f-47f1-bfb5-90a511b13cc4","Type":"ContainerStarted","Data":"b9083f1efc0c4f8a355d1659ca973670c043ba4ed6abd1c8aa9085248dc43d0d"}
Jul 07 22:09:36.006608 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:36.006316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:09:36.024520 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:36.024468    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx" podStartSLOduration=2.932386133 podStartE2EDuration="6.024454551s" totalImagesPullingTime="3.092068418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:36.022947504 +0000 UTC m=+357.032886682" watchObservedRunningTime="2026-07-07 22:09:36.024454551 +0000 UTC m=+357.034393729"
Jul 07 22:09:37.951700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:37.951668    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7qbxq"
Jul 07 22:09:37.953983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:37.953958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-g9b7j"
Jul 07 22:09:39.237974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.237943    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:39.250760 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250735    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istiod-ca-cert\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.250876 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250772    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-envoy\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.250876 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250803    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp4x4\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-kube-api-access-rp4x4\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.250876 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-credential-socket\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.250876 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-token\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.250876 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250868    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-socket\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.251114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250903    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-certs\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.251114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-podinfo\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.251114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.250979    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-data\") pod \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\" (UID: \"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8\") "
Jul 07 22:09:39.251286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251144    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:09:39.251286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251173    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:09:39.251286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251234    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:09:39.251428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251341    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:09:39.251428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251353    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-certs\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.251428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251372    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istiod-ca-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.251428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251385    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-credential-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.251428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.251401    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:09:39.253368 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.253342    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:09:39.253368 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.253344    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-kube-api-access-rp4x4" (OuterVolumeSpecName: "kube-api-access-rp4x4") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "kube-api-access-rp4x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:09:39.253749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.253725    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:09:39.253836 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.253740    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" (UID: "5234fc5f-2dfa-4752-ada5-a3eaf8d038f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:09:39.352584 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.352547    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-envoy\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.352584 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.352578    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp4x4\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-kube-api-access-rp4x4\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.352584 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.352588    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-token\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.352817 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.352598    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-workload-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.352817 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.352607    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-podinfo\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:39.352817 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:39.352615    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8-istio-data\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:09:40.025363 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.025326    2573 generic.go:356] "Generic (PLEG): container finished" podID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerID="87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54" exitCode=0
Jul 07 22:09:40.025538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.025377    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"
Jul 07 22:09:40.025538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.025420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" event={"ID":"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8","Type":"ContainerDied","Data":"87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54"}
Jul 07 22:09:40.025538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.025481    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg" event={"ID":"5234fc5f-2dfa-4752-ada5-a3eaf8d038f8","Type":"ContainerDied","Data":"96773f29c6a503b1906e88015c0d4b04a7002f9c34db80c71246c9846a52d98d"}
Jul 07 22:09:40.025538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.025509    2573 scope.go:117] "RemoveContainer" containerID="87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54"
Jul 07 22:09:40.034008 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.033989    2573 scope.go:117] "RemoveContainer" containerID="87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54"
Jul 07 22:09:40.034325 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:09:40.034303    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54\": container with ID starting with 87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54 not found: ID does not exist" containerID="87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54"
Jul 07 22:09:40.034382 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.034337    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54"} err="failed to get container status \"87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54\": rpc error: code = NotFound desc = could not find container \"87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54\": container with ID starting with 87150de97fb56504283d73728584f1ed093cc67dfcb1bebcd60f10da8c363a54 not found: ID does not exist"
Jul 07 22:09:40.043751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.043726    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"]
Jul 07 22:09:40.048372 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:40.048344    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xdjkg"]
Jul 07 22:09:41.504156 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:41.504118    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" path="/var/lib/kubelet/pods/5234fc5f-2dfa-4752-ada5-a3eaf8d038f8/volumes"
Jul 07 22:09:55.847808 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:55.847774    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:09:55.898188 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:09:55.898161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:00.660248 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:00.660188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:00.725914 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:00.725877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:06.011470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:06.011439    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lk5d2"
Jul 07 22:10:07.013093 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:07.013066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c5hxx"
Jul 07 22:10:20.966111 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:20.966077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:21.061410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.061374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:21.084408 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.084369    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lm7tg"]
Jul 07 22:10:21.084692 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.084677    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerName="istio-proxy"
Jul 07 22:10:21.084692 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.084692    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerName="istio-proxy"
Jul 07 22:10:21.084828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.084701    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6021dd66-c742-4f2b-87e2-31d47bd3c276" containerName="discovery"
Jul 07 22:10:21.084828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.084708    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6021dd66-c742-4f2b-87e2-31d47bd3c276" containerName="discovery"
Jul 07 22:10:21.084828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.084767    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6021dd66-c742-4f2b-87e2-31d47bd3c276" containerName="discovery"
Jul 07 22:10:21.084828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.084776    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5234fc5f-2dfa-4752-ada5-a3eaf8d038f8" containerName="istio-proxy"
Jul 07 22:10:21.091839 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.091807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg"
Jul 07 22:10:21.094874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.094457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 22:10:21.094874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.094709    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-q78dd\""
Jul 07 22:10:21.094874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.094819    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 22:10:21.095807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.095784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lm7tg"]
Jul 07 22:10:21.161470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.161440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:21.202724 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.202693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz5cb\" (UniqueName: \"kubernetes.io/projected/19b62760-3f7f-43c2-9e32-765c9a0e63f4-kube-api-access-lz5cb\") pod \"kuadrant-operator-catalog-lm7tg\" (UID: \"19b62760-3f7f-43c2-9e32-765c9a0e63f4\") " pod="kuadrant-system/kuadrant-operator-catalog-lm7tg"
Jul 07 22:10:21.303711 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.303675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz5cb\" (UniqueName: \"kubernetes.io/projected/19b62760-3f7f-43c2-9e32-765c9a0e63f4-kube-api-access-lz5cb\") pod \"kuadrant-operator-catalog-lm7tg\" (UID: \"19b62760-3f7f-43c2-9e32-765c9a0e63f4\") " pod="kuadrant-system/kuadrant-operator-catalog-lm7tg"
Jul 07 22:10:21.312055 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.312025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz5cb\" (UniqueName: \"kubernetes.io/projected/19b62760-3f7f-43c2-9e32-765c9a0e63f4-kube-api-access-lz5cb\") pod \"kuadrant-operator-catalog-lm7tg\" (UID: \"19b62760-3f7f-43c2-9e32-765c9a0e63f4\") " pod="kuadrant-system/kuadrant-operator-catalog-lm7tg"
Jul 07 22:10:21.403286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.403253    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg"
Jul 07 22:10:21.456688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.456655    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lm7tg"]
Jul 07 22:10:21.535216 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.535174    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lm7tg"]
Jul 07 22:10:21.537235 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:10:21.537189    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b62760_3f7f_43c2_9e32_765c9a0e63f4.slice/crio-c3c475d87555e1ec4e6ea9ef827833e793121bf012d668090ecff24ade8534ce WatchSource:0}: Error finding container c3c475d87555e1ec4e6ea9ef827833e793121bf012d668090ecff24ade8534ce: Status 404 returned error can't find the container with id c3c475d87555e1ec4e6ea9ef827833e793121bf012d668090ecff24ade8534ce
Jul 07 22:10:21.664577 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.664487    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4djgz"]
Jul 07 22:10:21.667491 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.667467    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:21.674024 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.673999    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4djgz"]
Jul 07 22:10:21.807518 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.807478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf8w2\" (UniqueName: \"kubernetes.io/projected/7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4-kube-api-access-hf8w2\") pod \"kuadrant-operator-catalog-4djgz\" (UID: \"7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4\") " pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:21.907854 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.907818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf8w2\" (UniqueName: \"kubernetes.io/projected/7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4-kube-api-access-hf8w2\") pod \"kuadrant-operator-catalog-4djgz\" (UID: \"7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4\") " pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:21.915396 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.915345    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf8w2\" (UniqueName: \"kubernetes.io/projected/7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4-kube-api-access-hf8w2\") pod \"kuadrant-operator-catalog-4djgz\" (UID: \"7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4\") " pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:21.978622 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:21.978585    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:22.107798 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:22.107770    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4djgz"]
Jul 07 22:10:22.110679 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:10:22.110650    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4ec9b4_a2ca_4ac2_9d98_62d0ebe326e4.slice/crio-eecc63d619a254a40756e2f4325afbed9e9e93a8380c0b13997975f816d58412 WatchSource:0}: Error finding container eecc63d619a254a40756e2f4325afbed9e9e93a8380c0b13997975f816d58412: Status 404 returned error can't find the container with id eecc63d619a254a40756e2f4325afbed9e9e93a8380c0b13997975f816d58412
Jul 07 22:10:22.212614 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:22.212526    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4djgz" event={"ID":"7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4","Type":"ContainerStarted","Data":"eecc63d619a254a40756e2f4325afbed9e9e93a8380c0b13997975f816d58412"}
Jul 07 22:10:22.219359 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:22.219317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg" event={"ID":"19b62760-3f7f-43c2-9e32-765c9a0e63f4","Type":"ContainerStarted","Data":"c3c475d87555e1ec4e6ea9ef827833e793121bf012d668090ecff24ade8534ce"}
Jul 07 22:10:24.231917 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.231879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4djgz" event={"ID":"7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4","Type":"ContainerStarted","Data":"7f4c3e6c1d3ae8fce2daf6838d44da4a50e8b08a7dc49ee464f7684f3d6a3680"}
Jul 07 22:10:24.233391 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.233357    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg" event={"ID":"19b62760-3f7f-43c2-9e32-765c9a0e63f4","Type":"ContainerStarted","Data":"175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2"}
Jul 07 22:10:24.233391 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.233372    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg" podUID="19b62760-3f7f-43c2-9e32-765c9a0e63f4" containerName="registry-server" containerID="cri-o://175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2" gracePeriod=2
Jul 07 22:10:24.248072 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.248021    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4djgz" podStartSLOduration=1.7584007179999999 podStartE2EDuration="3.248006914s" totalImagesPullingTime="1.489606196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:10:24.247060052 +0000 UTC m=+405.256999230" watchObservedRunningTime="2026-07-07 22:10:24.248006914 +0000 UTC m=+405.257946111"
Jul 07 22:10:24.263216 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.263156    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg" podStartSLOduration=1.203226337 podStartE2EDuration="3.263142801s" totalImagesPullingTime="2.059916464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:10:24.261980314 +0000 UTC m=+405.271919492" watchObservedRunningTime="2026-07-07 22:10:24.263142801 +0000 UTC m=+405.273082013"
Jul 07 22:10:24.472238 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.472189    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg"
Jul 07 22:10:24.638185 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.638140    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz5cb\" (UniqueName: \"kubernetes.io/projected/19b62760-3f7f-43c2-9e32-765c9a0e63f4-kube-api-access-lz5cb\") pod \"19b62760-3f7f-43c2-9e32-765c9a0e63f4\" (UID: \"19b62760-3f7f-43c2-9e32-765c9a0e63f4\") "
Jul 07 22:10:24.640452 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.640428    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b62760-3f7f-43c2-9e32-765c9a0e63f4-kube-api-access-lz5cb" (OuterVolumeSpecName: "kube-api-access-lz5cb") pod "19b62760-3f7f-43c2-9e32-765c9a0e63f4" (UID: "19b62760-3f7f-43c2-9e32-765c9a0e63f4"). InnerVolumeSpecName "kube-api-access-lz5cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:10:24.739281 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:24.739246    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz5cb\" (UniqueName: \"kubernetes.io/projected/19b62760-3f7f-43c2-9e32-765c9a0e63f4-kube-api-access-lz5cb\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:10:25.239518 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.239480    2573 generic.go:356] "Generic (PLEG): container finished" podID="19b62760-3f7f-43c2-9e32-765c9a0e63f4" containerID="175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2" exitCode=0
Jul 07 22:10:25.239896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.239530    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg"
Jul 07 22:10:25.239896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.239564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg" event={"ID":"19b62760-3f7f-43c2-9e32-765c9a0e63f4","Type":"ContainerDied","Data":"175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2"}
Jul 07 22:10:25.239896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.239610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lm7tg" event={"ID":"19b62760-3f7f-43c2-9e32-765c9a0e63f4","Type":"ContainerDied","Data":"c3c475d87555e1ec4e6ea9ef827833e793121bf012d668090ecff24ade8534ce"}
Jul 07 22:10:25.239896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.239630    2573 scope.go:117] "RemoveContainer" containerID="175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2"
Jul 07 22:10:25.248336 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.248321    2573 scope.go:117] "RemoveContainer" containerID="175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2"
Jul 07 22:10:25.248579 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:10:25.248562    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2\": container with ID starting with 175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2 not found: ID does not exist" containerID="175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2"
Jul 07 22:10:25.248641 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.248584    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2"} err="failed to get container status \"175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2\": rpc error: code = NotFound desc = could not find container \"175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2\": container with ID starting with 175224424aaafc2caf53b162faf7f83b5e5c168cee531e38d912410da47ac3b2 not found: ID does not exist"
Jul 07 22:10:25.258339 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.258321    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lm7tg"]
Jul 07 22:10:25.260580 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.260562    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lm7tg"]
Jul 07 22:10:25.503339 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:25.503299    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b62760-3f7f-43c2-9e32-765c9a0e63f4" path="/var/lib/kubelet/pods/19b62760-3f7f-43c2-9e32-765c9a0e63f4/volumes"
Jul 07 22:10:31.979378 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:31.979340    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:31.979976 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:31.979404    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:32.002286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:32.002261    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:32.294055 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:32.294027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4djgz"
Jul 07 22:10:39.058904 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.058869    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-864b6df6b4-p8spn"]
Jul 07 22:10:39.059309 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.059167    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b62760-3f7f-43c2-9e32-765c9a0e63f4" containerName="registry-server"
Jul 07 22:10:39.059309 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.059178    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b62760-3f7f-43c2-9e32-765c9a0e63f4" containerName="registry-server"
Jul 07 22:10:39.059309 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.059255    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b62760-3f7f-43c2-9e32-765c9a0e63f4" containerName="registry-server"
Jul 07 22:10:39.062468 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.062445    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.074359 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.074333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864b6df6b4-p8spn"]
Jul 07 22:10:39.113808 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.113776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:39.157976 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.157944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-oauth-serving-cert\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.158129 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.157997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-oauth-config\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.158129 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.158049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-serving-cert\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.158129 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.158069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-service-ca\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.158129 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.158091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-trusted-ca-bundle\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.158292 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.158136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-config\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.158292 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.158182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6wc2\" (UniqueName: \"kubernetes.io/projected/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-kube-api-access-l6wc2\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.166227 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.166183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:39.258746 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.258716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-serving-cert\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.258904 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.258754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-service-ca\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.258904 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.258780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-trusted-ca-bundle\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.258994 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.258904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-config\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.258994 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.258955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6wc2\" (UniqueName: \"kubernetes.io/projected/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-kube-api-access-l6wc2\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.259095 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.259000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-oauth-serving-cert\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.259095 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.259047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-oauth-config\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.259560 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.259533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-service-ca\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.259730 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.259700    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-config\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.259819 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.259776    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-oauth-serving-cert\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.260053 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.260031    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-trusted-ca-bundle\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.261515 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.261492    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-serving-cert\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.261596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.261533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-console-oauth-config\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.267912 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.267890    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6wc2\" (UniqueName: \"kubernetes.io/projected/7bc83e63-3659-4272-b2d6-4309bc1d1d9a-kube-api-access-l6wc2\") pod \"console-864b6df6b4-p8spn\" (UID: \"7bc83e63-3659-4272-b2d6-4309bc1d1d9a\") " pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.372085 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.371994    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:39.510983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:39.510962    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864b6df6b4-p8spn"]
Jul 07 22:10:39.512745 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:10:39.512714    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc83e63_3659_4272_b2d6_4309bc1d1d9a.slice/crio-7383160304e08e9553c4a5bb024e84f8ba335b018d4a1af5dd0dcfa28b46be59 WatchSource:0}: Error finding container 7383160304e08e9553c4a5bb024e84f8ba335b018d4a1af5dd0dcfa28b46be59: Status 404 returned error can't find the container with id 7383160304e08e9553c4a5bb024e84f8ba335b018d4a1af5dd0dcfa28b46be59
Jul 07 22:10:40.314625 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:40.314589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864b6df6b4-p8spn" event={"ID":"7bc83e63-3659-4272-b2d6-4309bc1d1d9a","Type":"ContainerStarted","Data":"4c28129400482d8d4d95663c0e8438ae8120d081189ca0f22a155299a59abe6d"}
Jul 07 22:10:40.315107 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:40.314642    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864b6df6b4-p8spn" event={"ID":"7bc83e63-3659-4272-b2d6-4309bc1d1d9a","Type":"ContainerStarted","Data":"7383160304e08e9553c4a5bb024e84f8ba335b018d4a1af5dd0dcfa28b46be59"}
Jul 07 22:10:40.332333 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:40.332286    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-864b6df6b4-p8spn" podStartSLOduration=1.332269019 podStartE2EDuration="1.332269019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:10:40.33046859 +0000 UTC m=+421.340407767" watchObservedRunningTime="2026-07-07 22:10:40.332269019 +0000 UTC m=+421.342208196"
Jul 07 22:10:49.372665 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:49.372632    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:49.373079 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:49.372970    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:49.377322 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:49.377303    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:49.769898 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:49.769870    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:50.329857 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:50.329824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:50.362709 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:50.362684    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-864b6df6b4-p8spn"
Jul 07 22:10:50.431061 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:50.431026    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8586578f87-sjjk5"]
Jul 07 22:10:50.548977 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:50.548941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:50.646546 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:50.646461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:50.749604 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:50.749567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:50.848010 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:50.847980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:51.232999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:51.232966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:51.329318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:51.329281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:53.797841 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:53.797806    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"]
Jul 07 22:10:53.803919 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:53.803900    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"
Jul 07 22:10:53.806124 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:53.806107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jhxs6\""
Jul 07 22:10:53.812858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:53.812835    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"]
Jul 07 22:10:53.887911 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:53.887873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbdx\" (UniqueName: \"kubernetes.io/projected/2a20f023-a69e-41b7-a87e-691f7fc54092-kube-api-access-kpbdx\") pod \"authorino-operator-75cc8d5cb7-tjccf\" (UID: \"2a20f023-a69e-41b7-a87e-691f7fc54092\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"
Jul 07 22:10:53.988879 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:53.988849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbdx\" (UniqueName: \"kubernetes.io/projected/2a20f023-a69e-41b7-a87e-691f7fc54092-kube-api-access-kpbdx\") pod \"authorino-operator-75cc8d5cb7-tjccf\" (UID: \"2a20f023-a69e-41b7-a87e-691f7fc54092\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"
Jul 07 22:10:53.999672 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:53.999637    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbdx\" (UniqueName: \"kubernetes.io/projected/2a20f023-a69e-41b7-a87e-691f7fc54092-kube-api-access-kpbdx\") pod \"authorino-operator-75cc8d5cb7-tjccf\" (UID: \"2a20f023-a69e-41b7-a87e-691f7fc54092\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"
Jul 07 22:10:54.115173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:54.115081    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"
Jul 07 22:10:54.255304 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:54.255281    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"]
Jul 07 22:10:54.257623 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:10:54.257595    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a20f023_a69e_41b7_a87e_691f7fc54092.slice/crio-6272a152687089e0931f332ff27077af90711678580a6b30c73acd30758e0b05 WatchSource:0}: Error finding container 6272a152687089e0931f332ff27077af90711678580a6b30c73acd30758e0b05: Status 404 returned error can't find the container with id 6272a152687089e0931f332ff27077af90711678580a6b30c73acd30758e0b05
Jul 07 22:10:54.378816 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:54.378605    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf" event={"ID":"2a20f023-a69e-41b7-a87e-691f7fc54092","Type":"ContainerStarted","Data":"6272a152687089e0931f332ff27077af90711678580a6b30c73acd30758e0b05"}
Jul 07 22:10:55.142750 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:55.142713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:56.391802 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:56.391766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf" event={"ID":"2a20f023-a69e-41b7-a87e-691f7fc54092","Type":"ContainerStarted","Data":"0a70b7b826c1f2853c06e320d7cdc1ff97c23491632be5f31f53b772da13d89d"}
Jul 07 22:10:56.392243 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:56.391859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"
Jul 07 22:10:56.407772 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:56.407721    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf" podStartSLOduration=1.371085379 podStartE2EDuration="3.407705683s" totalImagesPullingTime="2.036620304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:10:56.406768743 +0000 UTC m=+437.416707921" watchObservedRunningTime="2026-07-07 22:10:56.407705683 +0000 UTC m=+437.417644861"
Jul 07 22:10:57.050125 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.050091    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"]
Jul 07 22:10:57.053488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.053470    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:10:57.056325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.056302    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5gdr9\""
Jul 07 22:10:57.065212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.065173    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"]
Jul 07 22:10:57.117088 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.117046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwgh8\" (UniqueName: \"kubernetes.io/projected/edc209cd-6506-4508-9710-370e149a8484-kube-api-access-lwgh8\") pod \"limitador-operator-controller-manager-859d7b78bd-mpj7c\" (UID: \"edc209cd-6506-4508-9710-370e149a8484\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:10:57.216870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.216840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:57.217923 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.217901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwgh8\" (UniqueName: \"kubernetes.io/projected/edc209cd-6506-4508-9710-370e149a8484-kube-api-access-lwgh8\") pod \"limitador-operator-controller-manager-859d7b78bd-mpj7c\" (UID: \"edc209cd-6506-4508-9710-370e149a8484\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:10:57.231321 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.231299    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwgh8\" (UniqueName: \"kubernetes.io/projected/edc209cd-6506-4508-9710-370e149a8484-kube-api-access-lwgh8\") pod \"limitador-operator-controller-manager-859d7b78bd-mpj7c\" (UID: \"edc209cd-6506-4508-9710-370e149a8484\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:10:57.364361 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.364256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:10:57.504130 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.504107    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"]
Jul 07 22:10:57.505179 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:10:57.505159    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc209cd_6506_4508_9710_370e149a8484.slice/crio-0fe01aa7eb4013010b8ea73fb0b80688d91ba665c331c6c1f7802f05c76dbad1 WatchSource:0}: Error finding container 0fe01aa7eb4013010b8ea73fb0b80688d91ba665c331c6c1f7802f05c76dbad1: Status 404 returned error can't find the container with id 0fe01aa7eb4013010b8ea73fb0b80688d91ba665c331c6c1f7802f05c76dbad1
Jul 07 22:10:57.813396 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:57.813364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:10:58.406493 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:58.406453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c" event={"ID":"edc209cd-6506-4508-9710-370e149a8484","Type":"ContainerStarted","Data":"0fe01aa7eb4013010b8ea73fb0b80688d91ba665c331c6c1f7802f05c76dbad1"}
Jul 07 22:10:59.593546 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:10:59.593463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:00.417356 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:00.417326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c" event={"ID":"edc209cd-6506-4508-9710-370e149a8484","Type":"ContainerStarted","Data":"ac096b173fb193a2060c3ac4e913f3440b796b2f1ece44aa519e7f83bd44d463"}
Jul 07 22:11:00.417541 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:00.417388    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:00.435154 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:00.435099    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c" podStartSLOduration=1.565207119 podStartE2EDuration="3.435084023s" totalImagesPullingTime="1.869876904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:11:00.433981497 +0000 UTC m=+441.443920677" watchObservedRunningTime="2026-07-07 22:11:00.435084023 +0000 UTC m=+441.445023201"
Jul 07 22:11:01.373362 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:01.373322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:02.209151 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.209116    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"]
Jul 07 22:11:02.211408 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.211387    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.213792 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.213777    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5xlwb\""
Jul 07 22:11:02.228238 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.228176    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"]
Jul 07 22:11:02.363116 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.363079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22ce5f33-35e1-47d4-8043-25619dac2a47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.363314 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.363151    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s4m8\" (UniqueName: \"kubernetes.io/projected/22ce5f33-35e1-47d4-8043-25619dac2a47-kube-api-access-8s4m8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.463691 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.463587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s4m8\" (UniqueName: \"kubernetes.io/projected/22ce5f33-35e1-47d4-8043-25619dac2a47-kube-api-access-8s4m8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.463691 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.463640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22ce5f33-35e1-47d4-8043-25619dac2a47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.464231 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.464002    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22ce5f33-35e1-47d4-8043-25619dac2a47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.472675 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.472643    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s4m8\" (UniqueName: \"kubernetes.io/projected/22ce5f33-35e1-47d4-8043-25619dac2a47-kube-api-access-8s4m8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.521442 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.521396    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:02.658925 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.658876    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"]
Jul 07 22:11:02.661528 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:11:02.661502    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ce5f33_35e1_47d4_8043_25619dac2a47.slice/crio-4e451e78edff6b099f0ddf9ac9b23d4c9c01f49fcb78130a8e1b43face3ec036 WatchSource:0}: Error finding container 4e451e78edff6b099f0ddf9ac9b23d4c9c01f49fcb78130a8e1b43face3ec036: Status 404 returned error can't find the container with id 4e451e78edff6b099f0ddf9ac9b23d4c9c01f49fcb78130a8e1b43face3ec036
Jul 07 22:11:02.944513 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:02.944485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:03.431681 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:03.431651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp" event={"ID":"22ce5f33-35e1-47d4-8043-25619dac2a47","Type":"ContainerStarted","Data":"4e451e78edff6b099f0ddf9ac9b23d4c9c01f49fcb78130a8e1b43face3ec036"}
Jul 07 22:11:04.200100 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:04.200069    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:06.187322 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:06.187282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:06.286477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:06.286436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:06.543642 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:06.543604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:06.650590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:06.650536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:07.399547 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:07.399517    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tjccf"
Jul 07 22:11:09.463748 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:09.463709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp" event={"ID":"22ce5f33-35e1-47d4-8043-25619dac2a47","Type":"ContainerStarted","Data":"2b9656b1061623dfe5b7179bba62cfac4f6b8c4d5cf96dacc3c1e9d26667abf5"}
Jul 07 22:11:09.464150 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:09.463953    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:09.482954 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:09.482897    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp" podStartSLOduration=1.589418312 podStartE2EDuration="7.482878073s" totalImagesPullingTime="5.893459761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:11:09.481604882 +0000 UTC m=+450.491544060" watchObservedRunningTime="2026-07-07 22:11:09.482878073 +0000 UTC m=+450.492817251"
Jul 07 22:11:10.143701 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:10.143650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:10.245164 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:10.245126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:11.304287 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:11.304252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:11.424949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:11.424923    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:11.679687 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:11.679553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:13.342378 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:13.342343    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:13.462925 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:13.462892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:15.458153 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.458112    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8586578f87-sjjk5" podUID="d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" containerName="console" containerID="cri-o://4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328" gracePeriod=15
Jul 07 22:11:15.703363 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.703338    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:11:15.882278 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k48f\" (UniqueName: \"kubernetes.io/projected/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-kube-api-access-2k48f\") pod \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") "
Jul 07 22:11:15.882477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882318    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-serving-cert\") pod \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") "
Jul 07 22:11:15.882477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882346    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-oauth-serving-cert\") pod \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") "
Jul 07 22:11:15.882477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882381    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-config\") pod \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") "
Jul 07 22:11:15.882477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882409    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-service-ca\") pod \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") "
Jul 07 22:11:15.882683 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882484    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-trusted-ca-bundle\") pod \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") "
Jul 07 22:11:15.882683 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882514    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-oauth-config\") pod \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\" (UID: \"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75\") "
Jul 07 22:11:15.882921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882772    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" (UID: "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:11:15.882921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882896    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" (UID: "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:11:15.883075 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882778    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-service-ca" (OuterVolumeSpecName: "service-ca") pod "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" (UID: "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:11:15.883075 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.882782    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-config" (OuterVolumeSpecName: "console-config") pod "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" (UID: "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:11:15.883177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.883103    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-oauth-serving-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:15.883177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.883128    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-config\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:15.883177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.883142    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:15.883177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.883155    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-trusted-ca-bundle\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:15.884622 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.884588    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" (UID: "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:11:15.884710 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.884624    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-kube-api-access-2k48f" (OuterVolumeSpecName: "kube-api-access-2k48f") pod "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" (UID: "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75"). InnerVolumeSpecName "kube-api-access-2k48f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:11:15.884710 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.884674    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" (UID: "d88a7d78-3b05-44aa-b1b0-a07c04f5bf75"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:11:15.984077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.984049    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-oauth-config\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:15.984077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.984074    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k48f\" (UniqueName: \"kubernetes.io/projected/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-kube-api-access-2k48f\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:15.984077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:15.984085    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75-console-serving-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:16.495840 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.495804    2573 generic.go:356] "Generic (PLEG): container finished" podID="d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" containerID="4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328" exitCode=0
Jul 07 22:11:16.496365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.495854    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8586578f87-sjjk5"
Jul 07 22:11:16.496365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.495878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8586578f87-sjjk5" event={"ID":"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75","Type":"ContainerDied","Data":"4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328"}
Jul 07 22:11:16.496365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.495934    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8586578f87-sjjk5" event={"ID":"d88a7d78-3b05-44aa-b1b0-a07c04f5bf75","Type":"ContainerDied","Data":"1fc25b401932d492c169d06d30e05e3539e709c17765548af6ed6693069619f6"}
Jul 07 22:11:16.496365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.495966    2573 scope.go:117] "RemoveContainer" containerID="4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328"
Jul 07 22:11:16.504820 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.504802    2573 scope.go:117] "RemoveContainer" containerID="4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328"
Jul 07 22:11:16.505084 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:16.505067    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328\": container with ID starting with 4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328 not found: ID does not exist" containerID="4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328"
Jul 07 22:11:16.505150 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.505091    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328"} err="failed to get container status \"4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328\": rpc error: code = NotFound desc = could not find container \"4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328\": container with ID starting with 4e4bf02b1d9b8dcd76109815c72134d87d6cc27885556e7507ecb8139a710328 not found: ID does not exist"
Jul 07 22:11:16.516957 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.516924    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8586578f87-sjjk5"]
Jul 07 22:11:16.520821 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:16.520793    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8586578f87-sjjk5"]
Jul 07 22:11:17.503951 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:17.503920    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" path="/var/lib/kubelet/pods/d88a7d78-3b05-44aa-b1b0-a07c04f5bf75/volumes"
Jul 07 22:11:19.027916 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:19.027880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:19.125655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:19.125622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:20.470447 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:20.470420    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:21.559932 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.559904    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"]
Jul 07 22:11:21.560315 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.560249    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" containerName="console"
Jul 07 22:11:21.560315 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.560259    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" containerName="console"
Jul 07 22:11:21.560315 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.560316    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88a7d78-3b05-44aa-b1b0-a07c04f5bf75" containerName="console"
Jul 07 22:11:21.565399 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.565379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:21.577081 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.577054    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"]
Jul 07 22:11:21.728828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.728787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/350aa72c-a98f-46aa-97ea-e60587b705a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:21.729012 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.728910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmpvl\" (UniqueName: \"kubernetes.io/projected/350aa72c-a98f-46aa-97ea-e60587b705a0-kube-api-access-wmpvl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:21.829767 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.829687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpvl\" (UniqueName: \"kubernetes.io/projected/350aa72c-a98f-46aa-97ea-e60587b705a0-kube-api-access-wmpvl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:21.829767 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.829737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/350aa72c-a98f-46aa-97ea-e60587b705a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:21.830051 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.830035    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/350aa72c-a98f-46aa-97ea-e60587b705a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:21.837372 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.837352    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpvl\" (UniqueName: \"kubernetes.io/projected/350aa72c-a98f-46aa-97ea-e60587b705a0-kube-api-access-wmpvl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:21.876121 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:21.876086    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:22.032914 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.032890    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"]
Jul 07 22:11:22.035830 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:11:22.035803    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350aa72c_a98f_46aa_97ea_e60587b705a0.slice/crio-f25f74496783af539c9de13e731914547377546f8e0a4cb7ebbfe5070304200d WatchSource:0}: Error finding container f25f74496783af539c9de13e731914547377546f8e0a4cb7ebbfe5070304200d: Status 404 returned error can't find the container with id f25f74496783af539c9de13e731914547377546f8e0a4cb7ebbfe5070304200d
Jul 07 22:11:22.254668 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.254634    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"]
Jul 07 22:11:22.259172 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.259130    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"]
Jul 07 22:11:22.270400 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.270369    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"]
Jul 07 22:11:22.270571 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.270551    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" containerName="manager" containerID="cri-o://2b9656b1061623dfe5b7179bba62cfac4f6b8c4d5cf96dacc3c1e9d26667abf5" gracePeriod=2
Jul 07 22:11:22.279933 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.279692    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"]
Jul 07 22:11:22.280267 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.280246    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" containerName="manager"
Jul 07 22:11:22.280377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.280269    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" containerName="manager"
Jul 07 22:11:22.280377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.280356    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" containerName="manager"
Jul 07 22:11:22.284312 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.284290    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"]
Jul 07 22:11:22.284423 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.284400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.292634 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.292565    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"]
Jul 07 22:11:22.293385 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.293345    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"22ce5f33-35e1-47d4-8043-25619dac2a47\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:22.295294 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.295257    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:22.296210 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.296180    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"]
Jul 07 22:11:22.296568 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.296534    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" containerName="manager"
Jul 07 22:11:22.296568 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.296551    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" containerName="manager"
Jul 07 22:11:22.296749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.296622    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" containerName="manager"
Jul 07 22:11:22.299597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.299577    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.299760 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.299740    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"]
Jul 07 22:11:22.299912 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.299894    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c" podUID="edc209cd-6506-4508-9710-370e149a8484" containerName="manager" containerID="cri-o://ac096b173fb193a2060c3ac4e913f3440b796b2f1ece44aa519e7f83bd44d463" gracePeriod=2
Jul 07 22:11:22.305481 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.305431    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"]
Jul 07 22:11:22.315616 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.315357    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"]
Jul 07 22:11:22.321267 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.321242    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:22.343783 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.343700    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpj7c\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="edc209cd-6506-4508-9710-370e149a8484" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:22.453655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.453618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h6c7\" (UniqueName: \"kubernetes.io/projected/5267a4bf-bb34-4621-9888-98e4737d1cca-kube-api-access-9h6c7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v9rm2\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.453838 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.453674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5267a4bf-bb34-4621-9888-98e4737d1cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v9rm2\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.453838 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.453736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c974f\" (UniqueName: \"kubernetes.io/projected/c1967224-eb2f-4c06-8ade-1c2f0c2de429-kube-api-access-c974f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vjwl\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.453838 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.453780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1967224-eb2f-4c06-8ade-1c2f0c2de429-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vjwl\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.531560 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.531521    2573 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt" container="manager"
Jul 07 22:11:22.532901 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.532874    2573 generic.go:356] "Generic (PLEG): container finished" podID="22ce5f33-35e1-47d4-8043-25619dac2a47" containerID="2b9656b1061623dfe5b7179bba62cfac4f6b8c4d5cf96dacc3c1e9d26667abf5" exitCode=0
Jul 07 22:11:22.533037 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.532915    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e451e78edff6b099f0ddf9ac9b23d4c9c01f49fcb78130a8e1b43face3ec036"
Jul 07 22:11:22.533451 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.533419    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:22.534573 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.534551    2573 generic.go:356] "Generic (PLEG): container finished" podID="edc209cd-6506-4508-9710-370e149a8484" containerID="ac096b173fb193a2060c3ac4e913f3440b796b2f1ece44aa519e7f83bd44d463" exitCode=0
Jul 07 22:11:22.535648 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.535626    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:22.537745 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.537724    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:22.540563 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.540538    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpj7c\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="edc209cd-6506-4508-9710-370e149a8484" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:22.543434 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.543408    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:22.544753 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.544737    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:22.545138 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.545116    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:22.546943 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.546919    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpj7c\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="edc209cd-6506-4508-9710-370e149a8484" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:22.548771 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.548749    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:22.550626 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.550607    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8vp\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:22.552464 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:22.552443    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpj7c\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="edc209cd-6506-4508-9710-370e149a8484" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:22.554818 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.554798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c974f\" (UniqueName: \"kubernetes.io/projected/c1967224-eb2f-4c06-8ade-1c2f0c2de429-kube-api-access-c974f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vjwl\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.554907 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.554833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1967224-eb2f-4c06-8ade-1c2f0c2de429-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vjwl\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.554968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.554909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h6c7\" (UniqueName: \"kubernetes.io/projected/5267a4bf-bb34-4621-9888-98e4737d1cca-kube-api-access-9h6c7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v9rm2\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.555045 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.555022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5267a4bf-bb34-4621-9888-98e4737d1cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v9rm2\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.555250 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.555230    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1967224-eb2f-4c06-8ade-1c2f0c2de429-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vjwl\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.555316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.555297    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5267a4bf-bb34-4621-9888-98e4737d1cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v9rm2\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.568861 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.568835    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h6c7\" (UniqueName: \"kubernetes.io/projected/5267a4bf-bb34-4621-9888-98e4737d1cca-kube-api-access-9h6c7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v9rm2\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.568861 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.568859    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c974f\" (UniqueName: \"kubernetes.io/projected/c1967224-eb2f-4c06-8ade-1c2f0c2de429-kube-api-access-c974f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vjwl\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.656158 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.656068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s4m8\" (UniqueName: \"kubernetes.io/projected/22ce5f33-35e1-47d4-8043-25619dac2a47-kube-api-access-8s4m8\") pod \"22ce5f33-35e1-47d4-8043-25619dac2a47\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") "
Jul 07 22:11:22.656331 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.656166    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22ce5f33-35e1-47d4-8043-25619dac2a47-extensions-socket-volume\") pod \"22ce5f33-35e1-47d4-8043-25619dac2a47\" (UID: \"22ce5f33-35e1-47d4-8043-25619dac2a47\") "
Jul 07 22:11:22.656331 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.656191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwgh8\" (UniqueName: \"kubernetes.io/projected/edc209cd-6506-4508-9710-370e149a8484-kube-api-access-lwgh8\") pod \"edc209cd-6506-4508-9710-370e149a8484\" (UID: \"edc209cd-6506-4508-9710-370e149a8484\") "
Jul 07 22:11:22.656645 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.656617    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ce5f33-35e1-47d4-8043-25619dac2a47-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22ce5f33-35e1-47d4-8043-25619dac2a47" (UID: "22ce5f33-35e1-47d4-8043-25619dac2a47"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:11:22.658353 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.658329    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ce5f33-35e1-47d4-8043-25619dac2a47-kube-api-access-8s4m8" (OuterVolumeSpecName: "kube-api-access-8s4m8") pod "22ce5f33-35e1-47d4-8043-25619dac2a47" (UID: "22ce5f33-35e1-47d4-8043-25619dac2a47"). InnerVolumeSpecName "kube-api-access-8s4m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:11:22.658435 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.658364    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc209cd-6506-4508-9710-370e149a8484-kube-api-access-lwgh8" (OuterVolumeSpecName: "kube-api-access-lwgh8") pod "edc209cd-6506-4508-9710-370e149a8484" (UID: "edc209cd-6506-4508-9710-370e149a8484"). InnerVolumeSpecName "kube-api-access-lwgh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:11:22.691779 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.691750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:22.696745 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.696724    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:22.757923 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.757717    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwgh8\" (UniqueName: \"kubernetes.io/projected/edc209cd-6506-4508-9710-370e149a8484-kube-api-access-lwgh8\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:22.757923 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.757752    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s4m8\" (UniqueName: \"kubernetes.io/projected/22ce5f33-35e1-47d4-8043-25619dac2a47-kube-api-access-8s4m8\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:22.757923 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.757888    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22ce5f33-35e1-47d4-8043-25619dac2a47-extensions-socket-volume\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:22.848545 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.848507    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"]
Jul 07 22:11:22.851995 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:11:22.851953    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5267a4bf_bb34_4621_9888_98e4737d1cca.slice/crio-ca90f1adb9209a65dfffc779bade95d7e0bcb5c4df60b626398df4430d8a1645 WatchSource:0}: Error finding container ca90f1adb9209a65dfffc779bade95d7e0bcb5c4df60b626398df4430d8a1645: Status 404 returned error can't find the container with id ca90f1adb9209a65dfffc779bade95d7e0bcb5c4df60b626398df4430d8a1645
Jul 07 22:11:22.871599 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:22.871575    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"]
Jul 07 22:11:22.872974 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:11:22.872941    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1967224_eb2f_4c06_8ade_1c2f0c2de429.slice/crio-2a91f33fb42ba1d1cd14855fe936dcce6ff6927e25e62af1851b3189cfc811c1 WatchSource:0}: Error finding container 2a91f33fb42ba1d1cd14855fe936dcce6ff6927e25e62af1851b3189cfc811c1: Status 404 returned error can't find the container with id 2a91f33fb42ba1d1cd14855fe936dcce6ff6927e25e62af1851b3189cfc811c1
Jul 07 22:11:23.504207 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.504173    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22ce5f33-35e1-47d4-8043-25619dac2a47" path="/var/lib/kubelet/pods/22ce5f33-35e1-47d4-8043-25619dac2a47/volumes"
Jul 07 22:11:23.504548 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.504534    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc209cd-6506-4508-9710-370e149a8484" path="/var/lib/kubelet/pods/edc209cd-6506-4508-9710-370e149a8484/volumes"
Jul 07 22:11:23.540348 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.540317    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpj7c"
Jul 07 22:11:23.540520 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.540330    2573 scope.go:117] "RemoveContainer" containerID="ac096b173fb193a2060c3ac4e913f3440b796b2f1ece44aa519e7f83bd44d463"
Jul 07 22:11:23.542488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.542459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2" event={"ID":"5267a4bf-bb34-4621-9888-98e4737d1cca","Type":"ContainerStarted","Data":"44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b"}
Jul 07 22:11:23.542668 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.542644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2" event={"ID":"5267a4bf-bb34-4621-9888-98e4737d1cca","Type":"ContainerStarted","Data":"ca90f1adb9209a65dfffc779bade95d7e0bcb5c4df60b626398df4430d8a1645"}
Jul 07 22:11:23.542760 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.542682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:23.543876 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.543852    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" containerName="manager" containerID="cri-o://8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916" gracePeriod=2
Jul 07 22:11:23.545679 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.545659    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8vp"
Jul 07 22:11:23.545966 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.545942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl" event={"ID":"c1967224-eb2f-4c06-8ade-1c2f0c2de429","Type":"ContainerStarted","Data":"4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e"}
Jul 07 22:11:23.546069 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.545982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl" event={"ID":"c1967224-eb2f-4c06-8ade-1c2f0c2de429","Type":"ContainerStarted","Data":"2a91f33fb42ba1d1cd14855fe936dcce6ff6927e25e62af1851b3189cfc811c1"}
Jul 07 22:11:23.546069 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.546020    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:23.561135 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.561089    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2" podStartSLOduration=1.561074715 podStartE2EDuration="1.561074715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:11:23.559892385 +0000 UTC m=+464.569831563" watchObservedRunningTime="2026-07-07 22:11:23.561074715 +0000 UTC m=+464.571013892"
Jul 07 22:11:23.581776 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.581727    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl" podStartSLOduration=1.581713234 podStartE2EDuration="1.581713234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:11:23.580282632 +0000 UTC m=+464.590221819" watchObservedRunningTime="2026-07-07 22:11:23.581713234 +0000 UTC m=+464.591652412"
Jul 07 22:11:23.774436 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.774409    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:23.776560 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:23.776538    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:23.967451 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.967420    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmpvl\" (UniqueName: \"kubernetes.io/projected/350aa72c-a98f-46aa-97ea-e60587b705a0-kube-api-access-wmpvl\") pod \"350aa72c-a98f-46aa-97ea-e60587b705a0\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") "
Jul 07 22:11:23.967612 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.967503    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/350aa72c-a98f-46aa-97ea-e60587b705a0-extensions-socket-volume\") pod \"350aa72c-a98f-46aa-97ea-e60587b705a0\" (UID: \"350aa72c-a98f-46aa-97ea-e60587b705a0\") "
Jul 07 22:11:23.967749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.967724    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350aa72c-a98f-46aa-97ea-e60587b705a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "350aa72c-a98f-46aa-97ea-e60587b705a0" (UID: "350aa72c-a98f-46aa-97ea-e60587b705a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:11:23.969680 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:23.969651    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/350aa72c-a98f-46aa-97ea-e60587b705a0-kube-api-access-wmpvl" (OuterVolumeSpecName: "kube-api-access-wmpvl") pod "350aa72c-a98f-46aa-97ea-e60587b705a0" (UID: "350aa72c-a98f-46aa-97ea-e60587b705a0"). InnerVolumeSpecName "kube-api-access-wmpvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:11:24.068330 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.068238    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/350aa72c-a98f-46aa-97ea-e60587b705a0-extensions-socket-volume\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:24.068330 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.068273    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmpvl\" (UniqueName: \"kubernetes.io/projected/350aa72c-a98f-46aa-97ea-e60587b705a0-kube-api-access-wmpvl\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:24.551960 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.551924    2573 generic.go:356] "Generic (PLEG): container finished" podID="350aa72c-a98f-46aa-97ea-e60587b705a0" containerID="8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916" exitCode=2
Jul 07 22:11:24.552143 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.551967    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:24.552143 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.552030    2573 scope.go:117] "RemoveContainer" containerID="8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916"
Jul 07 22:11:24.554041 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:24.554020    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:24.561309 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.561288    2573 scope.go:117] "RemoveContainer" containerID="8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916"
Jul 07 22:11:24.561558 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:24.561541    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916\": container with ID starting with 8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916 not found: ID does not exist" containerID="8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916"
Jul 07 22:11:24.561632 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.561567    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916"} err="failed to get container status \"8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916\": rpc error: code = NotFound desc = could not find container \"8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916\": container with ID starting with 8878edf704ec2587d959d73440c94a431a875355f59cb45c34f6ceecbf54a916 not found: ID does not exist"
Jul 07 22:11:24.562164 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:24.562139    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4j8jt\" is forbidden: User \"system:node:ip-10-0-139-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-213.ec2.internal' and this object" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4j8jt"
Jul 07 22:11:24.571926 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.571907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:24.673251 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:24.673218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:25.167952 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:25.167919    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:25.231968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:25.231921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:25.504044 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:25.504007    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="350aa72c-a98f-46aa-97ea-e60587b705a0" path="/var/lib/kubelet/pods/350aa72c-a98f-46aa-97ea-e60587b705a0/volumes"
Jul 07 22:11:28.568774 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:28.568741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:28.670642 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:28.670607    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:32.174437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:32.174407    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:32.274875 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:32.274827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:34.554793 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.554769    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:34.555445 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.554828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:34.619311 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.619275    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"]
Jul 07 22:11:34.619502 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.619473    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl" podUID="c1967224-eb2f-4c06-8ade-1c2f0c2de429" containerName="manager" containerID="cri-o://4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e" gracePeriod=10
Jul 07 22:11:34.865162 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.865140    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:34.866179 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.866160    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"]
Jul 07 22:11:34.866505 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.866493    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc209cd-6506-4508-9710-370e149a8484" containerName="manager"
Jul 07 22:11:34.866544 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.866507    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc209cd-6506-4508-9710-370e149a8484" containerName="manager"
Jul 07 22:11:34.866544 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.866520    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1967224-eb2f-4c06-8ade-1c2f0c2de429" containerName="manager"
Jul 07 22:11:34.866544 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.866526    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1967224-eb2f-4c06-8ade-1c2f0c2de429" containerName="manager"
Jul 07 22:11:34.866640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.866579    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc209cd-6506-4508-9710-370e149a8484" containerName="manager"
Jul 07 22:11:34.866640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.866588    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1967224-eb2f-4c06-8ade-1c2f0c2de429" containerName="manager"
Jul 07 22:11:34.868373 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.868357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:34.886238 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.886216    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"]
Jul 07 22:11:34.947803 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.947772    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1967224-eb2f-4c06-8ade-1c2f0c2de429-extensions-socket-volume\") pod \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") "
Jul 07 22:11:34.947998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.947869    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c974f\" (UniqueName: \"kubernetes.io/projected/c1967224-eb2f-4c06-8ade-1c2f0c2de429-kube-api-access-c974f\") pod \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\" (UID: \"c1967224-eb2f-4c06-8ade-1c2f0c2de429\") "
Jul 07 22:11:34.948068 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.948007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7kk\" (UniqueName: \"kubernetes.io/projected/6275a69c-20df-486f-b804-b43a8e38c761-kube-api-access-ff7kk\") pod \"kuadrant-operator-controller-manager-86878c769f-rhkrf\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:34.948128 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.948090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275a69c-20df-486f-b804-b43a8e38c761-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rhkrf\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:34.948224 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.948165    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1967224-eb2f-4c06-8ade-1c2f0c2de429-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c1967224-eb2f-4c06-8ade-1c2f0c2de429" (UID: "c1967224-eb2f-4c06-8ade-1c2f0c2de429"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:11:34.950289 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:34.950260    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1967224-eb2f-4c06-8ade-1c2f0c2de429-kube-api-access-c974f" (OuterVolumeSpecName: "kube-api-access-c974f") pod "c1967224-eb2f-4c06-8ade-1c2f0c2de429" (UID: "c1967224-eb2f-4c06-8ade-1c2f0c2de429"). InnerVolumeSpecName "kube-api-access-c974f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:11:35.049011 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.048968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7kk\" (UniqueName: \"kubernetes.io/projected/6275a69c-20df-486f-b804-b43a8e38c761-kube-api-access-ff7kk\") pod \"kuadrant-operator-controller-manager-86878c769f-rhkrf\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:35.049184 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.049049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275a69c-20df-486f-b804-b43a8e38c761-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rhkrf\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:35.049184 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.049109    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1967224-eb2f-4c06-8ade-1c2f0c2de429-extensions-socket-volume\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:35.049184 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.049125    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c974f\" (UniqueName: \"kubernetes.io/projected/c1967224-eb2f-4c06-8ade-1c2f0c2de429-kube-api-access-c974f\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:35.049457 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.049431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275a69c-20df-486f-b804-b43a8e38c761-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rhkrf\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:35.058771 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.058738    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7kk\" (UniqueName: \"kubernetes.io/projected/6275a69c-20df-486f-b804-b43a8e38c761-kube-api-access-ff7kk\") pod \"kuadrant-operator-controller-manager-86878c769f-rhkrf\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:35.177900 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.177790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:35.312052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.311976    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"]
Jul 07 22:11:35.314882 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:11:35.314852    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6275a69c_20df_486f_b804_b43a8e38c761.slice/crio-81712bbce7b6aaf9ca6c94e693065297083c34e8c38b37bdb5701d856b711a4d WatchSource:0}: Error finding container 81712bbce7b6aaf9ca6c94e693065297083c34e8c38b37bdb5701d856b711a4d: Status 404 returned error can't find the container with id 81712bbce7b6aaf9ca6c94e693065297083c34e8c38b37bdb5701d856b711a4d
Jul 07 22:11:35.607661 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.607626    2573 generic.go:356] "Generic (PLEG): container finished" podID="c1967224-eb2f-4c06-8ade-1c2f0c2de429" containerID="4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e" exitCode=0
Jul 07 22:11:35.608067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.607672    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"
Jul 07 22:11:35.608067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.607708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl" event={"ID":"c1967224-eb2f-4c06-8ade-1c2f0c2de429","Type":"ContainerDied","Data":"4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e"}
Jul 07 22:11:35.608067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.607754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl" event={"ID":"c1967224-eb2f-4c06-8ade-1c2f0c2de429","Type":"ContainerDied","Data":"2a91f33fb42ba1d1cd14855fe936dcce6ff6927e25e62af1851b3189cfc811c1"}
Jul 07 22:11:35.608067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.607776    2573 scope.go:117] "RemoveContainer" containerID="4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e"
Jul 07 22:11:35.609733 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.609705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf" event={"ID":"6275a69c-20df-486f-b804-b43a8e38c761","Type":"ContainerStarted","Data":"d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace"}
Jul 07 22:11:35.609864 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.609756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf" event={"ID":"6275a69c-20df-486f-b804-b43a8e38c761","Type":"ContainerStarted","Data":"81712bbce7b6aaf9ca6c94e693065297083c34e8c38b37bdb5701d856b711a4d"}
Jul 07 22:11:35.609930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.609861    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:35.620800 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.620664    2573 scope.go:117] "RemoveContainer" containerID="4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e"
Jul 07 22:11:35.620964 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:35.620945    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e\": container with ID starting with 4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e not found: ID does not exist" containerID="4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e"
Jul 07 22:11:35.621035 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.620971    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e"} err="failed to get container status \"4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e\": rpc error: code = NotFound desc = could not find container \"4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e\": container with ID starting with 4afa75c70b0d037f4a32d812cdeddbdfe22ede411223f0c48079fc2538a1798e not found: ID does not exist"
Jul 07 22:11:35.626167 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.626144    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"]
Jul 07 22:11:35.631909 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.631888    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vjwl"]
Jul 07 22:11:35.650451 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:35.650407    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf" podStartSLOduration=1.650394206 podStartE2EDuration="1.650394206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:11:35.648324136 +0000 UTC m=+476.658263509" watchObservedRunningTime="2026-07-07 22:11:35.650394206 +0000 UTC m=+476.660333385"
Jul 07 22:11:37.503583 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:37.503549    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1967224-eb2f-4c06-8ade-1c2f0c2de429" path="/var/lib/kubelet/pods/c1967224-eb2f-4c06-8ade-1c2f0c2de429/volumes"
Jul 07 22:11:37.850358 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:37.850284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:37.948959 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:37.948900    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:39.387099 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:39.387072    2573 scope.go:117] "RemoveContainer" containerID="cd334e9b3445d5e9ac3d08772ea1d57ee6dbbee3bd6cc3dad692e4df4a1a27db"
Jul 07 22:11:44.639040 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:44.639002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:44.692142 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:44.692110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:46.617777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.617744    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:11:46.665250 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.665222    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"]
Jul 07 22:11:46.665454 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.665425    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2" podUID="5267a4bf-bb34-4621-9888-98e4737d1cca" containerName="manager" containerID="cri-o://44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b" gracePeriod=10
Jul 07 22:11:46.918857 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.918826    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:46.950188 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.950159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5267a4bf-bb34-4621-9888-98e4737d1cca-extensions-socket-volume\") pod \"5267a4bf-bb34-4621-9888-98e4737d1cca\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") "
Jul 07 22:11:46.950361 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.950252    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h6c7\" (UniqueName: \"kubernetes.io/projected/5267a4bf-bb34-4621-9888-98e4737d1cca-kube-api-access-9h6c7\") pod \"5267a4bf-bb34-4621-9888-98e4737d1cca\" (UID: \"5267a4bf-bb34-4621-9888-98e4737d1cca\") "
Jul 07 22:11:46.950543 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.950518    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5267a4bf-bb34-4621-9888-98e4737d1cca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5267a4bf-bb34-4621-9888-98e4737d1cca" (UID: "5267a4bf-bb34-4621-9888-98e4737d1cca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:11:46.952493 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:46.952458    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5267a4bf-bb34-4621-9888-98e4737d1cca-kube-api-access-9h6c7" (OuterVolumeSpecName: "kube-api-access-9h6c7") pod "5267a4bf-bb34-4621-9888-98e4737d1cca" (UID: "5267a4bf-bb34-4621-9888-98e4737d1cca"). InnerVolumeSpecName "kube-api-access-9h6c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:11:47.050751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.050717    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h6c7\" (UniqueName: \"kubernetes.io/projected/5267a4bf-bb34-4621-9888-98e4737d1cca-kube-api-access-9h6c7\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:47.050751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.050744    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5267a4bf-bb34-4621-9888-98e4737d1cca-extensions-socket-volume\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:11:47.666165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.666129    2573 generic.go:356] "Generic (PLEG): container finished" podID="5267a4bf-bb34-4621-9888-98e4737d1cca" containerID="44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b" exitCode=0
Jul 07 22:11:47.666165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.666170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2" event={"ID":"5267a4bf-bb34-4621-9888-98e4737d1cca","Type":"ContainerDied","Data":"44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b"}
Jul 07 22:11:47.666752 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.666192    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"
Jul 07 22:11:47.666752 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.666244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2" event={"ID":"5267a4bf-bb34-4621-9888-98e4737d1cca","Type":"ContainerDied","Data":"ca90f1adb9209a65dfffc779bade95d7e0bcb5c4df60b626398df4430d8a1645"}
Jul 07 22:11:47.666752 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.666266    2573 scope.go:117] "RemoveContainer" containerID="44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b"
Jul 07 22:11:47.674817 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.674799    2573 scope.go:117] "RemoveContainer" containerID="44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b"
Jul 07 22:11:47.675106 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:11:47.675081    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b\": container with ID starting with 44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b not found: ID does not exist" containerID="44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b"
Jul 07 22:11:47.675159 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.675103    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b"} err="failed to get container status \"44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b\": rpc error: code = NotFound desc = could not find container \"44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b\": container with ID starting with 44c60982b7e9d2d581bc83c79f96b98eac867435dd328ac99bb713b7f6c34a7b not found: ID does not exist"
Jul 07 22:11:47.686580 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.686548    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"]
Jul 07 22:11:47.688261 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:47.688235    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v9rm2"]
Jul 07 22:11:49.503947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:49.503915    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5267a4bf-bb34-4621-9888-98e4737d1cca" path="/var/lib/kubelet/pods/5267a4bf-bb34-4621-9888-98e4737d1cca/volumes"
Jul 07 22:11:51.027295 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.027267    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"]
Jul 07 22:11:51.027655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.027625    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5267a4bf-bb34-4621-9888-98e4737d1cca" containerName="manager"
Jul 07 22:11:51.027655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.027636    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5267a4bf-bb34-4621-9888-98e4737d1cca" containerName="manager"
Jul 07 22:11:51.027731 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.027691    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5267a4bf-bb34-4621-9888-98e4737d1cca" containerName="manager"
Jul 07 22:11:51.030525 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.030506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.033039 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.033013    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-59drx\""
Jul 07 22:11:51.041253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.041233    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"]
Jul 07 22:11:51.054488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.054463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:51.084081 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c50aa0-937b-4df5-975d-1cba8282e074-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084081 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c50aa0-937b-4df5-975d-1cba8282e074-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88cvb\" (UniqueName: \"kubernetes.io/projected/22c50aa0-937b-4df5-975d-1cba8282e074-kube-api-access-88cvb\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084425 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084425 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c50aa0-937b-4df5-975d-1cba8282e074-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.084425 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.084345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.184959 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.184926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c50aa0-937b-4df5-975d-1cba8282e074-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.184959 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.184965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c50aa0-937b-4df5-975d-1cba8282e074-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185252 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185252 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88cvb\" (UniqueName: \"kubernetes.io/projected/22c50aa0-937b-4df5-975d-1cba8282e074-kube-api-access-88cvb\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185542 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c50aa0-937b-4df5-975d-1cba8282e074-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185542 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185542 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185514    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185703 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185652    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185713    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185818 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185774    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.185872 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.185852    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c50aa0-937b-4df5-975d-1cba8282e074-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.187777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.187751    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c50aa0-937b-4df5-975d-1cba8282e074-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.187970 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.187951    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c50aa0-937b-4df5-975d-1cba8282e074-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.192558 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.192537    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c50aa0-937b-4df5-975d-1cba8282e074-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.192853 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.192832    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88cvb\" (UniqueName: \"kubernetes.io/projected/22c50aa0-937b-4df5-975d-1cba8282e074-kube-api-access-88cvb\") pod \"maas-default-gateway-openshift-default-56654dcf7-5ftk9\" (UID: \"22c50aa0-937b-4df5-975d-1cba8282e074\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.341977 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.341884    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:51.472963 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.472935    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"]
Jul 07 22:11:51.474552 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:11:51.474523    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c50aa0_937b_4df5_975d_1cba8282e074.slice/crio-05c7d5636bac380520d05399886bec4319252f8d0d056f9883160daf805f9630 WatchSource:0}: Error finding container 05c7d5636bac380520d05399886bec4319252f8d0d056f9883160daf805f9630: Status 404 returned error can't find the container with id 05c7d5636bac380520d05399886bec4319252f8d0d056f9883160daf805f9630
Jul 07 22:11:51.477020 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.476983    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:11:51.477126 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.477064    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:11:51.477126 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.477108    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:11:51.644761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.644667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:51.687921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.687879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" event={"ID":"22c50aa0-937b-4df5-975d-1cba8282e074","Type":"ContainerStarted","Data":"55e19d39897f77bfc8b8bdc08140b8bbb70f1871e91af06b4fae00bc428ea8df"}
Jul 07 22:11:51.688114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.687936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" event={"ID":"22c50aa0-937b-4df5-975d-1cba8282e074","Type":"ContainerStarted","Data":"05c7d5636bac380520d05399886bec4319252f8d0d056f9883160daf805f9630"}
Jul 07 22:11:51.714219 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:51.712918    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" podStartSLOduration=0.712894402 podStartE2EDuration="712.894402ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:11:51.711299377 +0000 UTC m=+492.721238557" watchObservedRunningTime="2026-07-07 22:11:51.712894402 +0000 UTC m=+492.722833582"
Jul 07 22:11:52.343000 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:52.342959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:52.347329 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:52.347306    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:52.368418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:52.368384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:11:52.693040 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:52.692945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:11:52.694065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:11:52.694049    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:12:07.172427 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.172388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:07.184927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.184891    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gcknt"]
Jul 07 22:12:07.189077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.189052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.191569 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.191545    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 22:12:07.191693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.191591    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f97sq\""
Jul 07 22:12:07.195899 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.195881    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gcknt"]
Jul 07 22:12:07.277684 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.277646    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gcknt"]
Jul 07 22:12:07.280067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.280037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:07.332499 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.332462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjxt\" (UniqueName: \"kubernetes.io/projected/ff94166e-7911-450b-a964-c9f1dde5b35a-kube-api-access-ffjxt\") pod \"limitador-limitador-64c94fd64f-gcknt\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.332661 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.332472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:07.332661 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.332563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff94166e-7911-450b-a964-c9f1dde5b35a-config-file\") pod \"limitador-limitador-64c94fd64f-gcknt\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.433838 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.433749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff94166e-7911-450b-a964-c9f1dde5b35a-config-file\") pod \"limitador-limitador-64c94fd64f-gcknt\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.433838 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.433837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjxt\" (UniqueName: \"kubernetes.io/projected/ff94166e-7911-450b-a964-c9f1dde5b35a-kube-api-access-ffjxt\") pod \"limitador-limitador-64c94fd64f-gcknt\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.434403 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.434385    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff94166e-7911-450b-a964-c9f1dde5b35a-config-file\") pod \"limitador-limitador-64c94fd64f-gcknt\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.442236 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.442184    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjxt\" (UniqueName: \"kubernetes.io/projected/ff94166e-7911-450b-a964-c9f1dde5b35a-kube-api-access-ffjxt\") pod \"limitador-limitador-64c94fd64f-gcknt\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.501169 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.501134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:07.638864 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.638817    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gcknt"]
Jul 07 22:12:07.641203 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:12:07.641171    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff94166e_7911_450b_a964_c9f1dde5b35a.slice/crio-680380f0552b4b11be0e4b1ae88fbdfc3a191c2687e463daded4da60cae86793 WatchSource:0}: Error finding container 680380f0552b4b11be0e4b1ae88fbdfc3a191c2687e463daded4da60cae86793: Status 404 returned error can't find the container with id 680380f0552b4b11be0e4b1ae88fbdfc3a191c2687e463daded4da60cae86793
Jul 07 22:12:07.760603 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.760558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt" event={"ID":"ff94166e-7911-450b-a964-c9f1dde5b35a","Type":"ContainerStarted","Data":"680380f0552b4b11be0e4b1ae88fbdfc3a191c2687e463daded4da60cae86793"}
Jul 07 22:12:07.991261 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.991225    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-62flt"]
Jul 07 22:12:07.994588 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.994566    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-62flt"
Jul 07 22:12:07.996623 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:07.996594    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bmfcm\""
Jul 07 22:12:08.000756 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.000734    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-62flt"]
Jul 07 22:12:08.018291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.018209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:08.076161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.076127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:08.139319 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.139284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgpx\" (UniqueName: \"kubernetes.io/projected/5e3ac277-992e-46f5-9fcf-b0c96651807a-kube-api-access-gjgpx\") pod \"authorino-58cd955675-62flt\" (UID: \"5e3ac277-992e-46f5-9fcf-b0c96651807a\") " pod="kuadrant-system/authorino-58cd955675-62flt"
Jul 07 22:12:08.240624 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.240588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgpx\" (UniqueName: \"kubernetes.io/projected/5e3ac277-992e-46f5-9fcf-b0c96651807a-kube-api-access-gjgpx\") pod \"authorino-58cd955675-62flt\" (UID: \"5e3ac277-992e-46f5-9fcf-b0c96651807a\") " pod="kuadrant-system/authorino-58cd955675-62flt"
Jul 07 22:12:08.248861 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.248831    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgpx\" (UniqueName: \"kubernetes.io/projected/5e3ac277-992e-46f5-9fcf-b0c96651807a-kube-api-access-gjgpx\") pod \"authorino-58cd955675-62flt\" (UID: \"5e3ac277-992e-46f5-9fcf-b0c96651807a\") " pod="kuadrant-system/authorino-58cd955675-62flt"
Jul 07 22:12:08.305150 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.305052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-62flt"
Jul 07 22:12:08.481873 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.480463    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-62flt"]
Jul 07 22:12:08.767185 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:08.767144    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-62flt" event={"ID":"5e3ac277-992e-46f5-9fcf-b0c96651807a","Type":"ContainerStarted","Data":"5b5c593d836368f2dfc8a12cc5e113382ae5a836dfe74aaa20835ffc9387d9cc"}
Jul 07 22:12:09.789688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:09.789608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:09.891456 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:09.891417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:12.691710 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:12.691676    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-62flt"]
Jul 07 22:12:12.793561 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:12.793523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt" event={"ID":"ff94166e-7911-450b-a964-c9f1dde5b35a","Type":"ContainerStarted","Data":"abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa"}
Jul 07 22:12:12.793746 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:12.793630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:12.795167 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:12.795134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-62flt" event={"ID":"5e3ac277-992e-46f5-9fcf-b0c96651807a","Type":"ContainerStarted","Data":"dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46"}
Jul 07 22:12:12.808873 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:12.808821    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt" podStartSLOduration=1.3316194430000001 podStartE2EDuration="5.808807908s" totalImagesPullingTime="4.477188465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:12:12.807570449 +0000 UTC m=+513.817509627" watchObservedRunningTime="2026-07-07 22:12:12.808807908 +0000 UTC m=+513.818747086"
Jul 07 22:12:12.821584 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:12.821540    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-62flt" podStartSLOduration=2.146259465 podStartE2EDuration="5.821528931s" totalImagesPullingTime="3.675269466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:12:12.82038063 +0000 UTC m=+513.830319808" watchObservedRunningTime="2026-07-07 22:12:12.821528931 +0000 UTC m=+513.831468112"
Jul 07 22:12:13.800113 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:13.800068    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-62flt" podUID="5e3ac277-992e-46f5-9fcf-b0c96651807a" containerName="authorino" containerID="cri-o://dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46" gracePeriod=30
Jul 07 22:12:14.046778 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.046754    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-62flt"
Jul 07 22:12:14.203533 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.203416    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjgpx\" (UniqueName: \"kubernetes.io/projected/5e3ac277-992e-46f5-9fcf-b0c96651807a-kube-api-access-gjgpx\") pod \"5e3ac277-992e-46f5-9fcf-b0c96651807a\" (UID: \"5e3ac277-992e-46f5-9fcf-b0c96651807a\") "
Jul 07 22:12:14.205696 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.205669    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3ac277-992e-46f5-9fcf-b0c96651807a-kube-api-access-gjgpx" (OuterVolumeSpecName: "kube-api-access-gjgpx") pod "5e3ac277-992e-46f5-9fcf-b0c96651807a" (UID: "5e3ac277-992e-46f5-9fcf-b0c96651807a"). InnerVolumeSpecName "kube-api-access-gjgpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:12:14.304535 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.304499    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjgpx\" (UniqueName: \"kubernetes.io/projected/5e3ac277-992e-46f5-9fcf-b0c96651807a-kube-api-access-gjgpx\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:12:14.805668 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.805629    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e3ac277-992e-46f5-9fcf-b0c96651807a" containerID="dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46" exitCode=0
Jul 07 22:12:14.805668 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.805668    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-62flt"
Jul 07 22:12:14.806210 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.805698    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-62flt" event={"ID":"5e3ac277-992e-46f5-9fcf-b0c96651807a","Type":"ContainerDied","Data":"dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46"}
Jul 07 22:12:14.806210 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.805740    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-62flt" event={"ID":"5e3ac277-992e-46f5-9fcf-b0c96651807a","Type":"ContainerDied","Data":"5b5c593d836368f2dfc8a12cc5e113382ae5a836dfe74aaa20835ffc9387d9cc"}
Jul 07 22:12:14.806210 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.805757    2573 scope.go:117] "RemoveContainer" containerID="dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46"
Jul 07 22:12:14.814652 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.814398    2573 scope.go:117] "RemoveContainer" containerID="dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46"
Jul 07 22:12:14.814804 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:12:14.814777    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46\": container with ID starting with dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46 not found: ID does not exist" containerID="dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46"
Jul 07 22:12:14.814890 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.814813    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46"} err="failed to get container status \"dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46\": rpc error: code = NotFound desc = could not find container \"dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46\": container with ID starting with dc6c22b94f04e167e59a196cff29d9d1adf11e04c699d49a8e29e98f48f6fd46 not found: ID does not exist"
Jul 07 22:12:14.833926 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.833887    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-62flt"]
Jul 07 22:12:14.835325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:14.835303    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-62flt"]
Jul 07 22:12:15.508372 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:15.508340    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3ac277-992e-46f5-9fcf-b0c96651807a" path="/var/lib/kubelet/pods/5e3ac277-992e-46f5-9fcf-b0c96651807a/volumes"
Jul 07 22:12:22.072415 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.072377    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gcknt"]
Jul 07 22:12:22.072856 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.072567    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt" podUID="ff94166e-7911-450b-a964-c9f1dde5b35a" containerName="limitador" containerID="cri-o://abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa" gracePeriod=30
Jul 07 22:12:22.073417 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.073351    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:22.622079 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.622057    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:22.674651 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.674546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffjxt\" (UniqueName: \"kubernetes.io/projected/ff94166e-7911-450b-a964-c9f1dde5b35a-kube-api-access-ffjxt\") pod \"ff94166e-7911-450b-a964-c9f1dde5b35a\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") "
Jul 07 22:12:22.674651 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.674628    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff94166e-7911-450b-a964-c9f1dde5b35a-config-file\") pod \"ff94166e-7911-450b-a964-c9f1dde5b35a\" (UID: \"ff94166e-7911-450b-a964-c9f1dde5b35a\") "
Jul 07 22:12:22.674987 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.674956    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff94166e-7911-450b-a964-c9f1dde5b35a-config-file" (OuterVolumeSpecName: "config-file") pod "ff94166e-7911-450b-a964-c9f1dde5b35a" (UID: "ff94166e-7911-450b-a964-c9f1dde5b35a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:12:22.676742 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.676715    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff94166e-7911-450b-a964-c9f1dde5b35a-kube-api-access-ffjxt" (OuterVolumeSpecName: "kube-api-access-ffjxt") pod "ff94166e-7911-450b-a964-c9f1dde5b35a" (UID: "ff94166e-7911-450b-a964-c9f1dde5b35a"). InnerVolumeSpecName "kube-api-access-ffjxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:12:22.775498 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.775462    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff94166e-7911-450b-a964-c9f1dde5b35a-config-file\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:12:22.775498 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.775492    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffjxt\" (UniqueName: \"kubernetes.io/projected/ff94166e-7911-450b-a964-c9f1dde5b35a-kube-api-access-ffjxt\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:12:22.843252 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.843217    2573 generic.go:356] "Generic (PLEG): container finished" podID="ff94166e-7911-450b-a964-c9f1dde5b35a" containerID="abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa" exitCode=0
Jul 07 22:12:22.843410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.843264    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt"
Jul 07 22:12:22.843410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.843284    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt" event={"ID":"ff94166e-7911-450b-a964-c9f1dde5b35a","Type":"ContainerDied","Data":"abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa"}
Jul 07 22:12:22.843410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.843335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gcknt" event={"ID":"ff94166e-7911-450b-a964-c9f1dde5b35a","Type":"ContainerDied","Data":"680380f0552b4b11be0e4b1ae88fbdfc3a191c2687e463daded4da60cae86793"}
Jul 07 22:12:22.843410 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.843357    2573 scope.go:117] "RemoveContainer" containerID="abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa"
Jul 07 22:12:22.851584 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.851566    2573 scope.go:117] "RemoveContainer" containerID="abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa"
Jul 07 22:12:22.851839 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:12:22.851817    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa\": container with ID starting with abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa not found: ID does not exist" containerID="abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa"
Jul 07 22:12:22.851881 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.851848    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa"} err="failed to get container status \"abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa\": rpc error: code = NotFound desc = could not find container \"abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa\": container with ID starting with abfb8ae753f96a508d6d44d07ac14dce7f0c72916c83d36a7a93415b78e799aa not found: ID does not exist"
Jul 07 22:12:22.863394 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.863363    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gcknt"]
Jul 07 22:12:22.867179 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:22.867158    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gcknt"]
Jul 07 22:12:23.503411 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:23.503381    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff94166e-7911-450b-a964-c9f1dde5b35a" path="/var/lib/kubelet/pods/ff94166e-7911-450b-a964-c9f1dde5b35a/volumes"
Jul 07 22:12:24.792657 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.792623    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-6kn2g"]
Jul 07 22:12:24.793148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.792947    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff94166e-7911-450b-a964-c9f1dde5b35a" containerName="limitador"
Jul 07 22:12:24.793148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.792959    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff94166e-7911-450b-a964-c9f1dde5b35a" containerName="limitador"
Jul 07 22:12:24.793148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.792969    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3ac277-992e-46f5-9fcf-b0c96651807a" containerName="authorino"
Jul 07 22:12:24.793148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.792975    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3ac277-992e-46f5-9fcf-b0c96651807a" containerName="authorino"
Jul 07 22:12:24.793148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.793029    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3ac277-992e-46f5-9fcf-b0c96651807a" containerName="authorino"
Jul 07 22:12:24.793148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.793038    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff94166e-7911-450b-a964-c9f1dde5b35a" containerName="limitador"
Jul 07 22:12:24.795723 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.795700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:24.797903 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.797884    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8d5bp\""
Jul 07 22:12:24.798009 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.797913    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 22:12:24.802400 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.802379    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-6kn2g"]
Jul 07 22:12:24.845241 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.845167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:24.894172 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.894135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7xlk\" (UniqueName: \"kubernetes.io/projected/c2ed8832-cbf0-4951-b321-3900f4ef8b1f-kube-api-access-l7xlk\") pod \"postgres-69fb4594cf-6kn2g\" (UID: \"c2ed8832-cbf0-4951-b321-3900f4ef8b1f\") " pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:24.894172 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.894170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2ed8832-cbf0-4951-b321-3900f4ef8b1f-data\") pod \"postgres-69fb4594cf-6kn2g\" (UID: \"c2ed8832-cbf0-4951-b321-3900f4ef8b1f\") " pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:24.994872 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.994838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7xlk\" (UniqueName: \"kubernetes.io/projected/c2ed8832-cbf0-4951-b321-3900f4ef8b1f-kube-api-access-l7xlk\") pod \"postgres-69fb4594cf-6kn2g\" (UID: \"c2ed8832-cbf0-4951-b321-3900f4ef8b1f\") " pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:24.994872 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.994877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2ed8832-cbf0-4951-b321-3900f4ef8b1f-data\") pod \"postgres-69fb4594cf-6kn2g\" (UID: \"c2ed8832-cbf0-4951-b321-3900f4ef8b1f\") " pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:24.995251 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:24.995233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2ed8832-cbf0-4951-b321-3900f4ef8b1f-data\") pod \"postgres-69fb4594cf-6kn2g\" (UID: \"c2ed8832-cbf0-4951-b321-3900f4ef8b1f\") " pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:25.003935 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:25.003909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7xlk\" (UniqueName: \"kubernetes.io/projected/c2ed8832-cbf0-4951-b321-3900f4ef8b1f-kube-api-access-l7xlk\") pod \"postgres-69fb4594cf-6kn2g\" (UID: \"c2ed8832-cbf0-4951-b321-3900f4ef8b1f\") " pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:25.109029 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:25.108935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:25.239931 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:25.239904    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-6kn2g"]
Jul 07 22:12:25.241575 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:12:25.241550    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ed8832_cbf0_4951_b321_3900f4ef8b1f.slice/crio-24c4ada50d2d484b03a89b595ca356f27b1c9eff8da3ece1d0ef444a4526df08 WatchSource:0}: Error finding container 24c4ada50d2d484b03a89b595ca356f27b1c9eff8da3ece1d0ef444a4526df08: Status 404 returned error can't find the container with id 24c4ada50d2d484b03a89b595ca356f27b1c9eff8da3ece1d0ef444a4526df08
Jul 07 22:12:25.861768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:25.861703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-6kn2g" event={"ID":"c2ed8832-cbf0-4951-b321-3900f4ef8b1f","Type":"ContainerStarted","Data":"24c4ada50d2d484b03a89b595ca356f27b1c9eff8da3ece1d0ef444a4526df08"}
Jul 07 22:12:30.893494 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:30.893455    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-6kn2g" event={"ID":"c2ed8832-cbf0-4951-b321-3900f4ef8b1f","Type":"ContainerStarted","Data":"b27bc7675012eca85296ecbd0db25b223b35c954b9ea91a740821054215dec80"}
Jul 07 22:12:30.893879 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:30.893613    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:30.910408 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:30.910354    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-6kn2g" podStartSLOduration=2.313267148 podStartE2EDuration="6.910338932s" totalImagesPullingTime="4.597071784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:12:30.908149215 +0000 UTC m=+531.918088405" watchObservedRunningTime="2026-07-07 22:12:30.910338932 +0000 UTC m=+531.920278110"
Jul 07 22:12:36.930910 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:36.930879    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-6kn2g"
Jul 07 22:12:37.280937 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.280905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:37.396682 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.396641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:37.542699 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.542618    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t6lxn"]
Jul 07 22:12:37.549629 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.549604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t6lxn"
Jul 07 22:12:37.551972 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.551953    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bmfcm\""
Jul 07 22:12:37.555854 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.555830    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t6lxn"]
Jul 07 22:12:37.607929 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.607891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgvkx\" (UniqueName: \"kubernetes.io/projected/dab680ad-8f31-48be-a43b-2bec50127931-kube-api-access-jgvkx\") pod \"authorino-5d4b67c446-t6lxn\" (UID: \"dab680ad-8f31-48be-a43b-2bec50127931\") " pod="kuadrant-system/authorino-5d4b67c446-t6lxn"
Jul 07 22:12:37.708591 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.708542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgvkx\" (UniqueName: \"kubernetes.io/projected/dab680ad-8f31-48be-a43b-2bec50127931-kube-api-access-jgvkx\") pod \"authorino-5d4b67c446-t6lxn\" (UID: \"dab680ad-8f31-48be-a43b-2bec50127931\") " pod="kuadrant-system/authorino-5d4b67c446-t6lxn"
Jul 07 22:12:37.717868 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.717844    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgvkx\" (UniqueName: \"kubernetes.io/projected/dab680ad-8f31-48be-a43b-2bec50127931-kube-api-access-jgvkx\") pod \"authorino-5d4b67c446-t6lxn\" (UID: \"dab680ad-8f31-48be-a43b-2bec50127931\") " pod="kuadrant-system/authorino-5d4b67c446-t6lxn"
Jul 07 22:12:37.812930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.812842    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t6lxn"]
Jul 07 22:12:37.813089 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.813076    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t6lxn"
Jul 07 22:12:37.837763 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.837734    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7865d5b996-kzbxc"]
Jul 07 22:12:37.841816 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.841793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865d5b996-kzbxc"
Jul 07 22:12:37.850606 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.850580    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7865d5b996-kzbxc"]
Jul 07 22:12:37.889580 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.889539    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7865d5b996-kzbxc"]
Jul 07 22:12:37.889853 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:12:37.889830    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nrzpz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7865d5b996-kzbxc" podUID="42f6b3e2-71c8-4915-beb3-11d98eaa5a51"
Jul 07 22:12:37.910960 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.910922    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzpz\" (UniqueName: \"kubernetes.io/projected/42f6b3e2-71c8-4915-beb3-11d98eaa5a51-kube-api-access-nrzpz\") pod \"authorino-7865d5b996-kzbxc\" (UID: \"42f6b3e2-71c8-4915-beb3-11d98eaa5a51\") " pod="kuadrant-system/authorino-7865d5b996-kzbxc"
Jul 07 22:12:37.928099 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.928067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865d5b996-kzbxc"
Jul 07 22:12:37.936837 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.936810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865d5b996-kzbxc"
Jul 07 22:12:37.962724 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:37.962693    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t6lxn"]
Jul 07 22:12:37.969525 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:12:37.969497    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddab680ad_8f31_48be_a43b_2bec50127931.slice/crio-952549b235eb4c72c2f51297ae40381b52c95927ee929242908d49a7d6b1aa3c WatchSource:0}: Error finding container 952549b235eb4c72c2f51297ae40381b52c95927ee929242908d49a7d6b1aa3c: Status 404 returned error can't find the container with id 952549b235eb4c72c2f51297ae40381b52c95927ee929242908d49a7d6b1aa3c
Jul 07 22:12:38.012011 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.011973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzpz\" (UniqueName: \"kubernetes.io/projected/42f6b3e2-71c8-4915-beb3-11d98eaa5a51-kube-api-access-nrzpz\") pod \"authorino-7865d5b996-kzbxc\" (UID: \"42f6b3e2-71c8-4915-beb3-11d98eaa5a51\") " pod="kuadrant-system/authorino-7865d5b996-kzbxc"
Jul 07 22:12:38.022781 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.022752    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzpz\" (UniqueName: \"kubernetes.io/projected/42f6b3e2-71c8-4915-beb3-11d98eaa5a51-kube-api-access-nrzpz\") pod \"authorino-7865d5b996-kzbxc\" (UID: \"42f6b3e2-71c8-4915-beb3-11d98eaa5a51\") " pod="kuadrant-system/authorino-7865d5b996-kzbxc"
Jul 07 22:12:38.112590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.112505    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrzpz\" (UniqueName: \"kubernetes.io/projected/42f6b3e2-71c8-4915-beb3-11d98eaa5a51-kube-api-access-nrzpz\") pod \"42f6b3e2-71c8-4915-beb3-11d98eaa5a51\" (UID: \"42f6b3e2-71c8-4915-beb3-11d98eaa5a51\") "
Jul 07 22:12:38.114655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.114629    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f6b3e2-71c8-4915-beb3-11d98eaa5a51-kube-api-access-nrzpz" (OuterVolumeSpecName: "kube-api-access-nrzpz") pod "42f6b3e2-71c8-4915-beb3-11d98eaa5a51" (UID: "42f6b3e2-71c8-4915-beb3-11d98eaa5a51"). InnerVolumeSpecName "kube-api-access-nrzpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:12:38.214012 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.213979    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrzpz\" (UniqueName: \"kubernetes.io/projected/42f6b3e2-71c8-4915-beb3-11d98eaa5a51-kube-api-access-nrzpz\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:12:38.934006 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.933974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865d5b996-kzbxc"
Jul 07 22:12:38.934006 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.933985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t6lxn" event={"ID":"dab680ad-8f31-48be-a43b-2bec50127931","Type":"ContainerStarted","Data":"f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2"}
Jul 07 22:12:38.934318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.934022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t6lxn" event={"ID":"dab680ad-8f31-48be-a43b-2bec50127931","Type":"ContainerStarted","Data":"952549b235eb4c72c2f51297ae40381b52c95927ee929242908d49a7d6b1aa3c"}
Jul 07 22:12:38.934318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.933956    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-t6lxn" podUID="dab680ad-8f31-48be-a43b-2bec50127931" containerName="authorino" containerID="cri-o://f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2" gracePeriod=30
Jul 07 22:12:38.952977 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.952934    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-t6lxn" podStartSLOduration=1.514334115 podStartE2EDuration="1.952918259s" totalImagesPullingTime="438.584144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:12:38.951134494 +0000 UTC m=+539.961073671" watchObservedRunningTime="2026-07-07 22:12:38.952918259 +0000 UTC m=+539.962857436"
Jul 07 22:12:38.976693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.976618    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7865d5b996-kzbxc"]
Jul 07 22:12:38.980807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:38.980778    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7865d5b996-kzbxc"]
Jul 07 22:12:39.194737 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.194703    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t6lxn"
Jul 07 22:12:39.321983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.321955    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgvkx\" (UniqueName: \"kubernetes.io/projected/dab680ad-8f31-48be-a43b-2bec50127931-kube-api-access-jgvkx\") pod \"dab680ad-8f31-48be-a43b-2bec50127931\" (UID: \"dab680ad-8f31-48be-a43b-2bec50127931\") "
Jul 07 22:12:39.324110 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.324085    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab680ad-8f31-48be-a43b-2bec50127931-kube-api-access-jgvkx" (OuterVolumeSpecName: "kube-api-access-jgvkx") pod "dab680ad-8f31-48be-a43b-2bec50127931" (UID: "dab680ad-8f31-48be-a43b-2bec50127931"). InnerVolumeSpecName "kube-api-access-jgvkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:12:39.424994 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.424962    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgvkx\" (UniqueName: \"kubernetes.io/projected/dab680ad-8f31-48be-a43b-2bec50127931-kube-api-access-jgvkx\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:12:39.505628 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.505593    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f6b3e2-71c8-4915-beb3-11d98eaa5a51" path="/var/lib/kubelet/pods/42f6b3e2-71c8-4915-beb3-11d98eaa5a51/volumes"
Jul 07 22:12:39.939591 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.939556    2573 generic.go:356] "Generic (PLEG): container finished" podID="dab680ad-8f31-48be-a43b-2bec50127931" containerID="f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2" exitCode=0
Jul 07 22:12:39.939772 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.939596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t6lxn" event={"ID":"dab680ad-8f31-48be-a43b-2bec50127931","Type":"ContainerDied","Data":"f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2"}
Jul 07 22:12:39.939772 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.939612    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t6lxn"
Jul 07 22:12:39.939772 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.939630    2573 scope.go:117] "RemoveContainer" containerID="f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2"
Jul 07 22:12:39.939772 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.939621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t6lxn" event={"ID":"dab680ad-8f31-48be-a43b-2bec50127931","Type":"ContainerDied","Data":"952549b235eb4c72c2f51297ae40381b52c95927ee929242908d49a7d6b1aa3c"}
Jul 07 22:12:39.947936 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.947917    2573 scope.go:117] "RemoveContainer" containerID="f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2"
Jul 07 22:12:39.948185 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:12:39.948167    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2\": container with ID starting with f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2 not found: ID does not exist" containerID="f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2"
Jul 07 22:12:39.948269 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.948216    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2"} err="failed to get container status \"f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2\": rpc error: code = NotFound desc = could not find container \"f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2\": container with ID starting with f9124219b92c2a4189f77bbe847e2f81d679f91d077acb74bbb708c35c036ad2 not found: ID does not exist"
Jul 07 22:12:39.954807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.954785    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t6lxn"]
Jul 07 22:12:39.957209 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:39.957173    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t6lxn"]
Jul 07 22:12:41.503279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:41.503250    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab680ad-8f31-48be-a43b-2bec50127931" path="/var/lib/kubelet/pods/dab680ad-8f31-48be-a43b-2bec50127931/volumes"
Jul 07 22:12:43.525241 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.525183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:43.533937 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.533909    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb9d974bd-cv75c"]
Jul 07 22:12:43.534277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.534263    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab680ad-8f31-48be-a43b-2bec50127931" containerName="authorino"
Jul 07 22:12:43.534277 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.534278    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab680ad-8f31-48be-a43b-2bec50127931" containerName="authorino"
Jul 07 22:12:43.534407 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.534334    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab680ad-8f31-48be-a43b-2bec50127931" containerName="authorino"
Jul 07 22:12:43.616450 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.616419    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb9d974bd-cv75c"]
Jul 07 22:12:43.616621 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.616539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.619220 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.619184    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 22:12:43.619348 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.619324    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 22:12:43.619424 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.619411    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nhkzm\""
Jul 07 22:12:43.623442 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.623238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:43.687473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.687439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:43.731005 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.730971    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6646f4f865-lkpsc"]
Jul 07 22:12:43.757047 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.757015    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6646f4f865-lkpsc"]
Jul 07 22:12:43.757252 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.757124    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:43.760615 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.760579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfb8e026-dfc0-450e-8c19-b597c6c3105a-webhook-cert\") pod \"maas-controller-bb9d974bd-cv75c\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") " pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.760754 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.760632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2hwd\" (UniqueName: \"kubernetes.io/projected/cfb8e026-dfc0-450e-8c19-b597c6c3105a-kube-api-access-w2hwd\") pod \"maas-controller-bb9d974bd-cv75c\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") " pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.862004 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.861913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsq4v\" (UniqueName: \"kubernetes.io/projected/6e1e1441-2db7-43c0-9339-0920f973baa7-kube-api-access-lsq4v\") pod \"maas-controller-6646f4f865-lkpsc\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") " pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:43.862004 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.861982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e1e1441-2db7-43c0-9339-0920f973baa7-webhook-cert\") pod \"maas-controller-6646f4f865-lkpsc\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") " pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:43.862286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.862086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfb8e026-dfc0-450e-8c19-b597c6c3105a-webhook-cert\") pod \"maas-controller-bb9d974bd-cv75c\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") " pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.862286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.862143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2hwd\" (UniqueName: \"kubernetes.io/projected/cfb8e026-dfc0-450e-8c19-b597c6c3105a-kube-api-access-w2hwd\") pod \"maas-controller-bb9d974bd-cv75c\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") " pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.863578 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.863538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:43.864761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.864744    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfb8e026-dfc0-450e-8c19-b597c6c3105a-webhook-cert\") pod \"maas-controller-bb9d974bd-cv75c\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") " pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.870418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.870396    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2hwd\" (UniqueName: \"kubernetes.io/projected/cfb8e026-dfc0-450e-8c19-b597c6c3105a-kube-api-access-w2hwd\") pod \"maas-controller-bb9d974bd-cv75c\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") " pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.926394 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.926357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:43.962923 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.962881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e1e1441-2db7-43c0-9339-0920f973baa7-webhook-cert\") pod \"maas-controller-6646f4f865-lkpsc\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") " pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:43.963075 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.962994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsq4v\" (UniqueName: \"kubernetes.io/projected/6e1e1441-2db7-43c0-9339-0920f973baa7-kube-api-access-lsq4v\") pod \"maas-controller-6646f4f865-lkpsc\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") " pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:43.965375 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.965348    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e1e1441-2db7-43c0-9339-0920f973baa7-webhook-cert\") pod \"maas-controller-6646f4f865-lkpsc\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") " pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:43.970707 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:43.970679    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsq4v\" (UniqueName: \"kubernetes.io/projected/6e1e1441-2db7-43c0-9339-0920f973baa7-kube-api-access-lsq4v\") pod \"maas-controller-6646f4f865-lkpsc\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") " pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:44.067728 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:44.067692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:44.080961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:44.080936    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb9d974bd-cv75c"]
Jul 07 22:12:44.083385 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:12:44.083357    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb8e026_dfc0_450e_8c19_b597c6c3105a.slice/crio-2cb49420b2b1354a8a93694dcd60ff610e39fc7c293ddba49271120d276253e3 WatchSource:0}: Error finding container 2cb49420b2b1354a8a93694dcd60ff610e39fc7c293ddba49271120d276253e3: Status 404 returned error can't find the container with id 2cb49420b2b1354a8a93694dcd60ff610e39fc7c293ddba49271120d276253e3
Jul 07 22:12:44.433651 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:44.433626    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6646f4f865-lkpsc"]
Jul 07 22:12:44.435444 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:12:44.435417    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1e1441_2db7_43c0_9339_0920f973baa7.slice/crio-529a60433010768ed059409649f477ba458d335354e5cd90c38545df75897f37 WatchSource:0}: Error finding container 529a60433010768ed059409649f477ba458d335354e5cd90c38545df75897f37: Status 404 returned error can't find the container with id 529a60433010768ed059409649f477ba458d335354e5cd90c38545df75897f37
Jul 07 22:12:44.966021 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:44.965980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb9d974bd-cv75c" event={"ID":"cfb8e026-dfc0-450e-8c19-b597c6c3105a","Type":"ContainerStarted","Data":"2cb49420b2b1354a8a93694dcd60ff610e39fc7c293ddba49271120d276253e3"}
Jul 07 22:12:44.967507 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:44.967478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6646f4f865-lkpsc" event={"ID":"6e1e1441-2db7-43c0-9339-0920f973baa7","Type":"ContainerStarted","Data":"529a60433010768ed059409649f477ba458d335354e5cd90c38545df75897f37"}
Jul 07 22:12:47.298179 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:47.298146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:47.401520 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:47.401474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:12:47.984671 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:47.984634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb9d974bd-cv75c" event={"ID":"cfb8e026-dfc0-450e-8c19-b597c6c3105a","Type":"ContainerStarted","Data":"3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538"}
Jul 07 22:12:47.984881 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:47.984697    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:47.986258 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:47.986229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6646f4f865-lkpsc" event={"ID":"6e1e1441-2db7-43c0-9339-0920f973baa7","Type":"ContainerStarted","Data":"251641c533053da0c3b55ac486e364deb1ea93ebbdc5b05cd67e65dad2ad1888"}
Jul 07 22:12:47.986396 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:47.986304    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:48.001819 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:48.001750    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bb9d974bd-cv75c" podStartSLOduration=2.039039209 podStartE2EDuration="5.001732515s" totalImagesPullingTime="2.962693306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:12:48.000782297 +0000 UTC m=+549.010721475" watchObservedRunningTime="2026-07-07 22:12:48.001732515 +0000 UTC m=+549.011671692"
Jul 07 22:12:48.016436 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:48.016384    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6646f4f865-lkpsc" podStartSLOduration=2.397736537 podStartE2EDuration="5.01636394s" totalImagesPullingTime="2.618627403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:12:48.015881734 +0000 UTC m=+549.025820912" watchObservedRunningTime="2026-07-07 22:12:48.01636394 +0000 UTC m=+549.026303164"
Jul 07 22:12:58.999700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:58.999670    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:59.000142 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:58.999820    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:12:59.054181 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.054149    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb9d974bd-cv75c"]
Jul 07 22:12:59.054402 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.054375    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-bb9d974bd-cv75c" podUID="cfb8e026-dfc0-450e-8c19-b597c6c3105a" containerName="manager" containerID="cri-o://3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538" gracePeriod=30
Jul 07 22:12:59.300921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.300894    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:12:59.402553 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.402524    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfb8e026-dfc0-450e-8c19-b597c6c3105a-webhook-cert\") pod \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") "
Jul 07 22:12:59.402728 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.402599    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2hwd\" (UniqueName: \"kubernetes.io/projected/cfb8e026-dfc0-450e-8c19-b597c6c3105a-kube-api-access-w2hwd\") pod \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\" (UID: \"cfb8e026-dfc0-450e-8c19-b597c6c3105a\") "
Jul 07 22:12:59.404834 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.404802    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb8e026-dfc0-450e-8c19-b597c6c3105a-kube-api-access-w2hwd" (OuterVolumeSpecName: "kube-api-access-w2hwd") pod "cfb8e026-dfc0-450e-8c19-b597c6c3105a" (UID: "cfb8e026-dfc0-450e-8c19-b597c6c3105a"). InnerVolumeSpecName "kube-api-access-w2hwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:12:59.404834 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.404808    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfb8e026-dfc0-450e-8c19-b597c6c3105a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cfb8e026-dfc0-450e-8c19-b597c6c3105a" (UID: "cfb8e026-dfc0-450e-8c19-b597c6c3105a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:12:59.503291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.503263    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfb8e026-dfc0-450e-8c19-b597c6c3105a-webhook-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:12:59.503291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:12:59.503285    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2hwd\" (UniqueName: \"kubernetes.io/projected/cfb8e026-dfc0-450e-8c19-b597c6c3105a-kube-api-access-w2hwd\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:13:00.045624 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.045587    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfb8e026-dfc0-450e-8c19-b597c6c3105a" containerID="3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538" exitCode=0
Jul 07 22:13:00.046110 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.045640    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb9d974bd-cv75c"
Jul 07 22:13:00.046110 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.045675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb9d974bd-cv75c" event={"ID":"cfb8e026-dfc0-450e-8c19-b597c6c3105a","Type":"ContainerDied","Data":"3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538"}
Jul 07 22:13:00.046110 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.045727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb9d974bd-cv75c" event={"ID":"cfb8e026-dfc0-450e-8c19-b597c6c3105a","Type":"ContainerDied","Data":"2cb49420b2b1354a8a93694dcd60ff610e39fc7c293ddba49271120d276253e3"}
Jul 07 22:13:00.046110 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.045748    2573 scope.go:117] "RemoveContainer" containerID="3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538"
Jul 07 22:13:00.054432 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.054422    2573 scope.go:117] "RemoveContainer" containerID="3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538"
Jul 07 22:13:00.054695 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:13:00.054679    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538\": container with ID starting with 3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538 not found: ID does not exist" containerID="3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538"
Jul 07 22:13:00.054749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.054701    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538"} err="failed to get container status \"3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538\": rpc error: code = NotFound desc = could not find container \"3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538\": container with ID starting with 3b85212f2a454cadc407571296437962e08bf4dbc57cd2f95a6eb63e882db538 not found: ID does not exist"
Jul 07 22:13:00.061052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.061029    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb9d974bd-cv75c"]
Jul 07 22:13:00.064082 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:00.064062    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bb9d974bd-cv75c"]
Jul 07 22:13:01.503414 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:01.503382    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfb8e026-dfc0-450e-8c19-b597c6c3105a" path="/var/lib/kubelet/pods/cfb8e026-dfc0-450e-8c19-b597c6c3105a/volumes"
Jul 07 22:13:21.440090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.440047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:21.855784 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.855754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:21.898333 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.898300    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6dcd777f48-28znx"]
Jul 07 22:13:21.898655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.898643    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb8e026-dfc0-450e-8c19-b597c6c3105a" containerName="manager"
Jul 07 22:13:21.898655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.898656    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb8e026-dfc0-450e-8c19-b597c6c3105a" containerName="manager"
Jul 07 22:13:21.898734 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.898713    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfb8e026-dfc0-450e-8c19-b597c6c3105a" containerName="manager"
Jul 07 22:13:21.901661 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.901628    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:21.904324 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.904299    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8l4tr\""
Jul 07 22:13:21.904648 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.904633    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 22:13:21.912186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:21.912167    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dcd777f48-28znx"]
Jul 07 22:13:22.003049 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.003013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4145ed70-fb11-4335-ab36-8467c737e1d0-maas-api-tls\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.003235 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.003071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4145ed70-fb11-4335-ab36-8467c737e1d0-openshift-service-ca\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.003313 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.003229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck8m2\" (UniqueName: \"kubernetes.io/projected/4145ed70-fb11-4335-ab36-8467c737e1d0-kube-api-access-ck8m2\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.098746 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.098709    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:22.103988 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.103954    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4145ed70-fb11-4335-ab36-8467c737e1d0-maas-api-tls\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.104171 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.104006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4145ed70-fb11-4335-ab36-8467c737e1d0-openshift-service-ca\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.104270 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.104248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck8m2\" (UniqueName: \"kubernetes.io/projected/4145ed70-fb11-4335-ab36-8467c737e1d0-kube-api-access-ck8m2\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.104961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.104934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4145ed70-fb11-4335-ab36-8467c737e1d0-openshift-service-ca\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.106675 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.106622    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4145ed70-fb11-4335-ab36-8467c737e1d0-maas-api-tls\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.112143 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.112118    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck8m2\" (UniqueName: \"kubernetes.io/projected/4145ed70-fb11-4335-ab36-8467c737e1d0-kube-api-access-ck8m2\") pod \"maas-api-6dcd777f48-28znx\" (UID: \"4145ed70-fb11-4335-ab36-8467c737e1d0\") " pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.212674 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.212637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:22.286022 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.285988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:22.364070 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.364046    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dcd777f48-28znx"]
Jul 07 22:13:22.366436 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:13:22.366406    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4145ed70_fb11_4335_ab36_8467c737e1d0.slice/crio-82311082f62c0c078e7d3600f094291feb2fc58571348fff9abefdb46b0e68ff WatchSource:0}: Error finding container 82311082f62c0c078e7d3600f094291feb2fc58571348fff9abefdb46b0e68ff: Status 404 returned error can't find the container with id 82311082f62c0c078e7d3600f094291feb2fc58571348fff9abefdb46b0e68ff
Jul 07 22:13:22.366783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.366762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:22.388989 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.388956    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-n8mzv"]
Jul 07 22:13:22.391946 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.391922    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.394250 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.394230    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 22:13:22.394369 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.394296    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hc6cc\""
Jul 07 22:13:22.402007 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.401980    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-n8mzv"]
Jul 07 22:13:22.418635 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.418603    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7djc7"]
Jul 07 22:13:22.420967 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.420947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.436521 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.436499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7djc7"]
Jul 07 22:13:22.507617 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.507581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6zg\" (UniqueName: \"kubernetes.io/projected/e788e6af-11b8-4ac1-b9ed-582f39138c86-kube-api-access-sz6zg\") pod \"payload-pre-processing-7964457696-n8mzv\" (UID: \"e788e6af-11b8-4ac1-b9ed-582f39138c86\") " pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.507617 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.507623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjmjx\" (UniqueName: \"kubernetes.io/projected/c6c41c43-6538-4460-b108-04f47d8ef440-kube-api-access-vjmjx\") pod \"payload-processing-58f86c7798-7djc7\" (UID: \"c6c41c43-6538-4460-b108-04f47d8ef440\") " pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.508097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.507649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e788e6af-11b8-4ac1-b9ed-582f39138c86-plugins-config-volume\") pod \"payload-pre-processing-7964457696-n8mzv\" (UID: \"e788e6af-11b8-4ac1-b9ed-582f39138c86\") " pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.508097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.507724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c41c43-6538-4460-b108-04f47d8ef440-plugins-config-volume\") pod \"payload-processing-58f86c7798-7djc7\" (UID: \"c6c41c43-6538-4460-b108-04f47d8ef440\") " pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.608608 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.608578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6zg\" (UniqueName: \"kubernetes.io/projected/e788e6af-11b8-4ac1-b9ed-582f39138c86-kube-api-access-sz6zg\") pod \"payload-pre-processing-7964457696-n8mzv\" (UID: \"e788e6af-11b8-4ac1-b9ed-582f39138c86\") " pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.608783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.608615    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjmjx\" (UniqueName: \"kubernetes.io/projected/c6c41c43-6538-4460-b108-04f47d8ef440-kube-api-access-vjmjx\") pod \"payload-processing-58f86c7798-7djc7\" (UID: \"c6c41c43-6538-4460-b108-04f47d8ef440\") " pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.608783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.608640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e788e6af-11b8-4ac1-b9ed-582f39138c86-plugins-config-volume\") pod \"payload-pre-processing-7964457696-n8mzv\" (UID: \"e788e6af-11b8-4ac1-b9ed-582f39138c86\") " pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.608895 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.608795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c41c43-6538-4460-b108-04f47d8ef440-plugins-config-volume\") pod \"payload-processing-58f86c7798-7djc7\" (UID: \"c6c41c43-6538-4460-b108-04f47d8ef440\") " pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.609395 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.609363    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e788e6af-11b8-4ac1-b9ed-582f39138c86-plugins-config-volume\") pod \"payload-pre-processing-7964457696-n8mzv\" (UID: \"e788e6af-11b8-4ac1-b9ed-582f39138c86\") " pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.609782 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.609761    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c41c43-6538-4460-b108-04f47d8ef440-plugins-config-volume\") pod \"payload-processing-58f86c7798-7djc7\" (UID: \"c6c41c43-6538-4460-b108-04f47d8ef440\") " pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.616785 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.616719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6zg\" (UniqueName: \"kubernetes.io/projected/e788e6af-11b8-4ac1-b9ed-582f39138c86-kube-api-access-sz6zg\") pod \"payload-pre-processing-7964457696-n8mzv\" (UID: \"e788e6af-11b8-4ac1-b9ed-582f39138c86\") " pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.617050 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.617032    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjmjx\" (UniqueName: \"kubernetes.io/projected/c6c41c43-6538-4460-b108-04f47d8ef440-kube-api-access-vjmjx\") pod \"payload-processing-58f86c7798-7djc7\" (UID: \"c6c41c43-6538-4460-b108-04f47d8ef440\") " pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.703090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.703055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:22.730639 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.730613    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:22.855643 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.855547    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-n8mzv"]
Jul 07 22:13:22.858048 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:13:22.858019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode788e6af_11b8_4ac1_b9ed_582f39138c86.slice/crio-5b7ce1d910b08e1a0ec9bd5fb85e7605831e6f325b6facd1915ebc819f0b54a1 WatchSource:0}: Error finding container 5b7ce1d910b08e1a0ec9bd5fb85e7605831e6f325b6facd1915ebc819f0b54a1: Status 404 returned error can't find the container with id 5b7ce1d910b08e1a0ec9bd5fb85e7605831e6f325b6facd1915ebc819f0b54a1
Jul 07 22:13:22.880511 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:22.880488    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7djc7"]
Jul 07 22:13:22.882941 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:13:22.882912    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c41c43_6538_4460_b108_04f47d8ef440.slice/crio-9715584afb7fda5eb32dab450de6d41618366fdeb593a7a9530c9dcdab7f459a WatchSource:0}: Error finding container 9715584afb7fda5eb32dab450de6d41618366fdeb593a7a9530c9dcdab7f459a: Status 404 returned error can't find the container with id 9715584afb7fda5eb32dab450de6d41618366fdeb593a7a9530c9dcdab7f459a
Jul 07 22:13:23.177058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:23.176925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dcd777f48-28znx" event={"ID":"4145ed70-fb11-4335-ab36-8467c737e1d0","Type":"ContainerStarted","Data":"82311082f62c0c078e7d3600f094291feb2fc58571348fff9abefdb46b0e68ff"}
Jul 07 22:13:23.178977 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:23.178911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7djc7" event={"ID":"c6c41c43-6538-4460-b108-04f47d8ef440","Type":"ContainerStarted","Data":"9715584afb7fda5eb32dab450de6d41618366fdeb593a7a9530c9dcdab7f459a"}
Jul 07 22:13:23.180377 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:23.180348    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv" event={"ID":"e788e6af-11b8-4ac1-b9ed-582f39138c86","Type":"ContainerStarted","Data":"5b7ce1d910b08e1a0ec9bd5fb85e7605831e6f325b6facd1915ebc819f0b54a1"}
Jul 07 22:13:25.195064 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.194950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dcd777f48-28znx" event={"ID":"4145ed70-fb11-4335-ab36-8467c737e1d0","Type":"ContainerStarted","Data":"65b2fea873233d8a6c06fbf531aa305b64cb841bd92e8871ea46b0e711c86bea"}
Jul 07 22:13:25.195526 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.195090    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:25.196481 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.196455    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7djc7" event={"ID":"c6c41c43-6538-4460-b108-04f47d8ef440","Type":"ContainerStarted","Data":"9904037d71d88b1e98218a74d46bda81d147d977df9e7ae8ac6f1d7e880c2946"}
Jul 07 22:13:25.196542 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.196528    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:25.198031 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.198012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv" event={"ID":"e788e6af-11b8-4ac1-b9ed-582f39138c86","Type":"ContainerStarted","Data":"e324e8bf86fbdd9230d717ea58165790b4cd9bf466d1aeda867f90069f78cb4c"}
Jul 07 22:13:25.198237 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.198217    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:25.212310 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.212261    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6dcd777f48-28znx" podStartSLOduration=1.747886346 podStartE2EDuration="4.212243904s" totalImagesPullingTime="2.464357558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:13:25.2101382 +0000 UTC m=+586.220077381" watchObservedRunningTime="2026-07-07 22:13:25.212243904 +0000 UTC m=+586.222183082"
Jul 07 22:13:25.224470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.224414    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-7djc7" podStartSLOduration=1.277057696 podStartE2EDuration="3.224395306s" totalImagesPullingTime="1.94733761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:13:25.223345223 +0000 UTC m=+586.233284402" watchObservedRunningTime="2026-07-07 22:13:25.224395306 +0000 UTC m=+586.234334485"
Jul 07 22:13:25.237123 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:25.237068    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv" podStartSLOduration=1.262565911 podStartE2EDuration="3.2370529s" totalImagesPullingTime="1.974486989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:13:25.235764559 +0000 UTC m=+586.245703736" watchObservedRunningTime="2026-07-07 22:13:25.2370529 +0000 UTC m=+586.246992078"
Jul 07 22:13:30.229153 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:30.229066    2573 generic.go:356] "Generic (PLEG): container finished" podID="22c50aa0-937b-4df5-975d-1cba8282e074" containerID="55e19d39897f77bfc8b8bdc08140b8bbb70f1871e91af06b4fae00bc428ea8df" exitCode=0
Jul 07 22:13:30.229153 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:30.229105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" event={"ID":"22c50aa0-937b-4df5-975d-1cba8282e074","Type":"ContainerDied","Data":"55e19d39897f77bfc8b8bdc08140b8bbb70f1871e91af06b4fae00bc428ea8df"}
Jul 07 22:13:30.229655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:30.229528    2573 scope.go:117] "RemoveContainer" containerID="55e19d39897f77bfc8b8bdc08140b8bbb70f1871e91af06b4fae00bc428ea8df"
Jul 07 22:13:30.230504 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:30.230474    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:13:30.230556 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:30.230545    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:13:30.230590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:30.230576    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:13:31.209176 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:31.209145    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6dcd777f48-28znx"
Jul 07 22:13:31.237602 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:31.237564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" event={"ID":"22c50aa0-937b-4df5-975d-1cba8282e074","Type":"ContainerStarted","Data":"b4fdebcdcea6acfaa04942de4dcecdf419e79d2aa09ae6249bcd10ee11b8ed31"}
Jul 07 22:13:31.342087 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:31.342044    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:13:31.342292 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:31.342271    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5ftk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:13:31.342351 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:31.342332    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" podUID="22c50aa0-937b-4df5-975d-1cba8282e074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 22:13:32.283016 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:32.282984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:32.342975 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:32.342939    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5ftk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:13:32.343161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:32.342995    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" podUID="22c50aa0-937b-4df5-975d-1cba8282e074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 22:13:32.380025 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:32.379983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:33.342992 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:33.342957    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5ftk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:13:33.343398 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:33.343022    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" podUID="22c50aa0-937b-4df5-975d-1cba8282e074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 22:13:34.342473 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:34.342435    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5ftk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:13:34.342652 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:34.342521    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9" podUID="22c50aa0-937b-4df5-975d-1cba8282e074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 22:13:35.346434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:35.346400    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:13:35.346826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:35.346681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:13:35.347296 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:35.347278    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5ftk9"
Jul 07 22:13:36.205192 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:36.205158    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv" podUID="e788e6af-11b8-4ac1-b9ed-582f39138c86" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.50:9004: connect: connection refused"
Jul 07 22:13:36.205411 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:36.205368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-7djc7"
Jul 07 22:13:39.383012 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:39.382984    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:13:39.383489 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:39.383470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:13:46.205113 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:46.205082    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-n8mzv"
Jul 07 22:13:53.493912 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.493873    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"]
Jul 07 22:13:53.498090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.498057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.500644 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.500615    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 22:13:53.500803 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.500688    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 22:13:53.502226 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.501965    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 22:13:53.502226 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.502021    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wd56t\""
Jul 07 22:13:53.516153 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.515754    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"]
Jul 07 22:13:53.531739 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.531708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:13:53.598233 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.598158    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.598406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.598240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.598406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.598308    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmwvq\" (UniqueName: \"kubernetes.io/projected/a7df73e2-c031-4669-a3cf-1f16355c07db-kube-api-access-kmwvq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.598406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.598354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.598406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.598378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7df73e2-c031-4669-a3cf-1f16355c07db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.598546 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.598441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699119 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699119 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7df73e2-c031-4669-a3cf-1f16355c07db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699418 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699562 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmwvq\" (UniqueName: \"kubernetes.io/projected/a7df73e2-c031-4669-a3cf-1f16355c07db-kube-api-access-kmwvq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699626 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699595    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699683 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699622    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.699738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.699705    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.701697 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.701671    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7df73e2-c031-4669-a3cf-1f16355c07db-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.701804 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.701779    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7df73e2-c031-4669-a3cf-1f16355c07db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.708303 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.708285    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmwvq\" (UniqueName: \"kubernetes.io/projected/a7df73e2-c031-4669-a3cf-1f16355c07db-kube-api-access-kmwvq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj\" (UID: \"a7df73e2-c031-4669-a3cf-1f16355c07db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.820276 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.820231    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:13:53.962576 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:53.962486    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"]
Jul 07 22:13:53.965382 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:13:53.965353    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7df73e2_c031_4669_a3cf_1f16355c07db.slice/crio-4e2754e8e277865f3eceab0a858bfaa5696a475624471975a2a8b4f41189df76 WatchSource:0}: Error finding container 4e2754e8e277865f3eceab0a858bfaa5696a475624471975a2a8b4f41189df76: Status 404 returned error can't find the container with id 4e2754e8e277865f3eceab0a858bfaa5696a475624471975a2a8b4f41189df76
Jul 07 22:13:54.367664 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:54.367630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj" event={"ID":"a7df73e2-c031-4669-a3cf-1f16355c07db","Type":"ContainerStarted","Data":"4e2754e8e277865f3eceab0a858bfaa5696a475624471975a2a8b4f41189df76"}
Jul 07 22:13:55.375286 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:55.375239    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj" event={"ID":"a7df73e2-c031-4669-a3cf-1f16355c07db","Type":"ContainerStarted","Data":"cc7a5a2dea963b55a4c72775ff9c6fc298d7840f9d23f37e88f384559f6667dc"}
Jul 07 22:13:55.392777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:13:55.392729    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj" podStartSLOduration=1.179175339 podStartE2EDuration="2.392714822s" totalImagesPullingTime="1.213539483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:13:55.391108507 +0000 UTC m=+616.401047685" watchObservedRunningTime="2026-07-07 22:13:55.392714822 +0000 UTC m=+616.402653999"
Jul 07 22:14:03.821381 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:03.821295    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:14:03.821381 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:03.821364    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:14:03.834156 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:03.834127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:14:04.430631 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:04.430601    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj"
Jul 07 22:14:11.143062 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:11.143019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:24.752535 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:24.752488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:30.603958 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.603925    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"]
Jul 07 22:14:30.610184 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.610161    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.612511 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.612491    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 22:14:30.616967 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.616945    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"]
Jul 07 22:14:30.644585 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.644550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:30.719259 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.719223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.719439 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.719270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.719439 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.719317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp84q\" (UniqueName: \"kubernetes.io/projected/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-kube-api-access-fp84q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.719439 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.719335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.719439 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.719389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.719590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.719449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.820847 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.820810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.820875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp84q\" (UniqueName: \"kubernetes.io/projected/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-kube-api-access-fp84q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.820895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.820913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.820951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821052 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.820991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821503 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.821479    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821595 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.821505    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.821595 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.821540    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.823415 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.823397    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.823593 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.823576    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.833699 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.833672    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp84q\" (UniqueName: \"kubernetes.io/projected/a66919ba-f7bb-493a-a4ea-fdfd75f43e26-kube-api-access-fp84q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85\" (UID: \"a66919ba-f7bb-493a-a4ea-fdfd75f43e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:30.922332 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:30.922234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:31.068614 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:31.068575    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"]
Jul 07 22:14:31.069082 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:14:31.069062    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66919ba_f7bb_493a_a4ea_fdfd75f43e26.slice/crio-6071804a25382c7e9666a677dfbaa350bf90984d3795f3714efc684c716149d3 WatchSource:0}: Error finding container 6071804a25382c7e9666a677dfbaa350bf90984d3795f3714efc684c716149d3: Status 404 returned error can't find the container with id 6071804a25382c7e9666a677dfbaa350bf90984d3795f3714efc684c716149d3
Jul 07 22:14:31.070539 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:31.070520    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:14:31.562430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:31.562331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85" event={"ID":"a66919ba-f7bb-493a-a4ea-fdfd75f43e26","Type":"ContainerStarted","Data":"4962f57fe5d4e44e686d7918ea218102ceef9f3e3f22a8531747703703067150"}
Jul 07 22:14:31.562430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:31.562397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85" event={"ID":"a66919ba-f7bb-493a-a4ea-fdfd75f43e26","Type":"ContainerStarted","Data":"6071804a25382c7e9666a677dfbaa350bf90984d3795f3714efc684c716149d3"}
Jul 07 22:14:31.582732 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:31.582682    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85" podStartSLOduration=1.3970611 podStartE2EDuration="1.58266519s" totalImagesPullingTime="185.60409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:31.580699045 +0000 UTC m=+652.590638220" watchObservedRunningTime="2026-07-07 22:14:31.58266519 +0000 UTC m=+652.592604378"
Jul 07 22:14:40.922538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:40.922496    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:40.923018 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:40.922627    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:40.935106 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:40.935082    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:41.624104 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.624070    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85"
Jul 07 22:14:41.804978 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.804945    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"]
Jul 07 22:14:41.808092 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.808070    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:41.810592 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.810568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 22:14:41.819178 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.819156    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"]
Jul 07 22:14:41.837298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.837272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:41.919998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.919915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:41.919998 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.919947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:41.920228 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.920065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:41.920228 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.920110    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6430fedc-0324-4991-8f05-f7b417d17a0e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:41.920228 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.920178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:41.920329 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:41.920223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w28mw\" (UniqueName: \"kubernetes.io/projected/6430fedc-0324-4991-8f05-f7b417d17a0e-kube-api-access-w28mw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6430fedc-0324-4991-8f05-f7b417d17a0e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w28mw\" (UniqueName: \"kubernetes.io/projected/6430fedc-0324-4991-8f05-f7b417d17a0e-kube-api-access-w28mw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021595    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021613    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.021902 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.021651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.023692 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.023657    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6430fedc-0324-4991-8f05-f7b417d17a0e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.023804 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.023752    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6430fedc-0324-4991-8f05-f7b417d17a0e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.028980 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.028955    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w28mw\" (UniqueName: \"kubernetes.io/projected/6430fedc-0324-4991-8f05-f7b417d17a0e-kube-api-access-w28mw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8mrb\" (UID: \"6430fedc-0324-4991-8f05-f7b417d17a0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.119804 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.119769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:42.259380 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.259345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"]
Jul 07 22:14:42.261577 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:14:42.261549    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6430fedc_0324_4991_8f05_f7b417d17a0e.slice/crio-729d3aa965e9a1b4f40c5d32457d9beb758dc0ca7ebfbc2ea75b360df1360f8e WatchSource:0}: Error finding container 729d3aa965e9a1b4f40c5d32457d9beb758dc0ca7ebfbc2ea75b360df1360f8e: Status 404 returned error can't find the container with id 729d3aa965e9a1b4f40c5d32457d9beb758dc0ca7ebfbc2ea75b360df1360f8e
Jul 07 22:14:42.620136 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.620100    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb" event={"ID":"6430fedc-0324-4991-8f05-f7b417d17a0e","Type":"ContainerStarted","Data":"871df29893287f55b4d4d035fc80672e05a8758fb587d95db40464c25d6fe8a8"}
Jul 07 22:14:42.620346 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.620156    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb" event={"ID":"6430fedc-0324-4991-8f05-f7b417d17a0e","Type":"ContainerStarted","Data":"729d3aa965e9a1b4f40c5d32457d9beb758dc0ca7ebfbc2ea75b360df1360f8e"}
Jul 07 22:14:42.637273 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:42.637218    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb" podStartSLOduration=1.455877771 podStartE2EDuration="1.637187637s" totalImagesPullingTime="181.309866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:42.636014201 +0000 UTC m=+663.645953380" watchObservedRunningTime="2026-07-07 22:14:42.637187637 +0000 UTC m=+663.647126815"
Jul 07 22:14:52.120584 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:52.120540    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:52.121044 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:52.120605    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:52.133141 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:52.133112    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:52.680620 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:52.680589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8mrb"
Jul 07 22:14:52.935144 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:14:52.935047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:04.524474 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:04.524433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:16.892527 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:16.892492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:17.199445 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:17.199358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:21.790090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:21.790037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:45.239600 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:45.239517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:45.343470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:45.343427    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:46.438684 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:46.438650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:46.536804 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:15:46.536769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:01.982573 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:01.982487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:02.072562 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.072521    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6646f4f865-lkpsc"]
Jul 07 22:17:02.072855 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.072828    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6646f4f865-lkpsc" podUID="6e1e1441-2db7-43c0-9339-0920f973baa7" containerName="manager" containerID="cri-o://251641c533053da0c3b55ac486e364deb1ea93ebbdc5b05cd67e65dad2ad1888" gracePeriod=30
Jul 07 22:17:02.319176 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.319150    2573 generic.go:356] "Generic (PLEG): container finished" podID="6e1e1441-2db7-43c0-9339-0920f973baa7" containerID="251641c533053da0c3b55ac486e364deb1ea93ebbdc5b05cd67e65dad2ad1888" exitCode=0
Jul 07 22:17:02.319321 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.319236    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6646f4f865-lkpsc" event={"ID":"6e1e1441-2db7-43c0-9339-0920f973baa7","Type":"ContainerDied","Data":"251641c533053da0c3b55ac486e364deb1ea93ebbdc5b05cd67e65dad2ad1888"}
Jul 07 22:17:02.319321 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.319303    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6646f4f865-lkpsc" event={"ID":"6e1e1441-2db7-43c0-9339-0920f973baa7","Type":"ContainerDied","Data":"529a60433010768ed059409649f477ba458d335354e5cd90c38545df75897f37"}
Jul 07 22:17:02.319408 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.319328    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="529a60433010768ed059409649f477ba458d335354e5cd90c38545df75897f37"
Jul 07 22:17:02.331642 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.331621    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:17:02.438035 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.437996    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e1e1441-2db7-43c0-9339-0920f973baa7-webhook-cert\") pod \"6e1e1441-2db7-43c0-9339-0920f973baa7\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") "
Jul 07 22:17:02.438255 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.438075    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsq4v\" (UniqueName: \"kubernetes.io/projected/6e1e1441-2db7-43c0-9339-0920f973baa7-kube-api-access-lsq4v\") pod \"6e1e1441-2db7-43c0-9339-0920f973baa7\" (UID: \"6e1e1441-2db7-43c0-9339-0920f973baa7\") "
Jul 07 22:17:02.440305 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.440273    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1e1441-2db7-43c0-9339-0920f973baa7-kube-api-access-lsq4v" (OuterVolumeSpecName: "kube-api-access-lsq4v") pod "6e1e1441-2db7-43c0-9339-0920f973baa7" (UID: "6e1e1441-2db7-43c0-9339-0920f973baa7"). InnerVolumeSpecName "kube-api-access-lsq4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:17:02.440305 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.440282    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1e1441-2db7-43c0-9339-0920f973baa7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6e1e1441-2db7-43c0-9339-0920f973baa7" (UID: "6e1e1441-2db7-43c0-9339-0920f973baa7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:17:02.539807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.539761    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsq4v\" (UniqueName: \"kubernetes.io/projected/6e1e1441-2db7-43c0-9339-0920f973baa7-kube-api-access-lsq4v\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:17:02.539807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:02.539798    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e1e1441-2db7-43c0-9339-0920f973baa7-webhook-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:17:03.324173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:03.324133    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6646f4f865-lkpsc"
Jul 07 22:17:03.344859 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:03.344834    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6646f4f865-lkpsc"]
Jul 07 22:17:03.350162 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:03.350137    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6646f4f865-lkpsc"]
Jul 07 22:17:03.504770 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:03.504734    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1e1441-2db7-43c0-9339-0920f973baa7" path="/var/lib/kubelet/pods/6e1e1441-2db7-43c0-9339-0920f973baa7/volumes"
Jul 07 22:17:04.031397 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.031359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:04.085191 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.085155    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6646f4f865-pqwjb"]
Jul 07 22:17:04.085570 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.085556    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1e1441-2db7-43c0-9339-0920f973baa7" containerName="manager"
Jul 07 22:17:04.085628 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.085572    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1e1441-2db7-43c0-9339-0920f973baa7" containerName="manager"
Jul 07 22:17:04.085697 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.085676    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1e1441-2db7-43c0-9339-0920f973baa7" containerName="manager"
Jul 07 22:17:04.089184 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.089164    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.092401 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.092380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 22:17:04.092533 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.092380    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 22:17:04.092533 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.092380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nhkzm\""
Jul 07 22:17:04.096882 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.096839    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6646f4f865-pqwjb"]
Jul 07 22:17:04.257438 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.257405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5q4\" (UniqueName: \"kubernetes.io/projected/88cdccf1-954c-4dfd-af99-436bd974d48b-kube-api-access-zp5q4\") pod \"maas-controller-6646f4f865-pqwjb\" (UID: \"88cdccf1-954c-4dfd-af99-436bd974d48b\") " pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.257641 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.257550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/88cdccf1-954c-4dfd-af99-436bd974d48b-webhook-cert\") pod \"maas-controller-6646f4f865-pqwjb\" (UID: \"88cdccf1-954c-4dfd-af99-436bd974d48b\") " pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.358820 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.358722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/88cdccf1-954c-4dfd-af99-436bd974d48b-webhook-cert\") pod \"maas-controller-6646f4f865-pqwjb\" (UID: \"88cdccf1-954c-4dfd-af99-436bd974d48b\") " pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.358820 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.358795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5q4\" (UniqueName: \"kubernetes.io/projected/88cdccf1-954c-4dfd-af99-436bd974d48b-kube-api-access-zp5q4\") pod \"maas-controller-6646f4f865-pqwjb\" (UID: \"88cdccf1-954c-4dfd-af99-436bd974d48b\") " pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.361504 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.361482    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/88cdccf1-954c-4dfd-af99-436bd974d48b-webhook-cert\") pod \"maas-controller-6646f4f865-pqwjb\" (UID: \"88cdccf1-954c-4dfd-af99-436bd974d48b\") " pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.366853 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.366827    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5q4\" (UniqueName: \"kubernetes.io/projected/88cdccf1-954c-4dfd-af99-436bd974d48b-kube-api-access-zp5q4\") pod \"maas-controller-6646f4f865-pqwjb\" (UID: \"88cdccf1-954c-4dfd-af99-436bd974d48b\") " pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.400757 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.400726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:04.539406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:04.539352    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6646f4f865-pqwjb"]
Jul 07 22:17:04.541757 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:17:04.541731    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cdccf1_954c_4dfd_af99_436bd974d48b.slice/crio-19fb65617e9d6b334d91c20c243ec98463e4f9278d1cd69a67ca2904582181a5 WatchSource:0}: Error finding container 19fb65617e9d6b334d91c20c243ec98463e4f9278d1cd69a67ca2904582181a5: Status 404 returned error can't find the container with id 19fb65617e9d6b334d91c20c243ec98463e4f9278d1cd69a67ca2904582181a5
Jul 07 22:17:05.336166 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:05.336125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6646f4f865-pqwjb" event={"ID":"88cdccf1-954c-4dfd-af99-436bd974d48b","Type":"ContainerStarted","Data":"363f1d5b4fe531fcfb9a102d5d9c9a2fc105caf43d5ca011672b20375481cef2"}
Jul 07 22:17:05.336404 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:05.336191    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:05.336404 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:05.336246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6646f4f865-pqwjb" event={"ID":"88cdccf1-954c-4dfd-af99-436bd974d48b","Type":"ContainerStarted","Data":"19fb65617e9d6b334d91c20c243ec98463e4f9278d1cd69a67ca2904582181a5"}
Jul 07 22:17:05.353180 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:05.353129    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6646f4f865-pqwjb" podStartSLOduration=0.733406717 podStartE2EDuration="1.353113904s" totalImagesPullingTime="619.707187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:17:05.351418937 +0000 UTC m=+806.361358139" watchObservedRunningTime="2026-07-07 22:17:05.353113904 +0000 UTC m=+806.363053163"
Jul 07 22:17:10.251474 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:10.251436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:10.352729 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:10.352672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:16.346849 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:16.346816    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6646f4f865-pqwjb"
Jul 07 22:17:39.483669 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:39.483623    2573 scope.go:117] "RemoveContainer" containerID="2b9656b1061623dfe5b7179bba62cfac4f6b8c4d5cf96dacc3c1e9d26667abf5"
Jul 07 22:17:46.609835 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:46.609801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:46.709719 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:46.709680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:46.886076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:46.885972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:52.659001 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:52.658947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:52.760008 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:52.759972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:52.860090 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:52.860058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:53.004450 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:53.004417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:59.283371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:59.283335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:17:59.362562 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:17:59.362511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:18:16.525430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:18:16.525398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:18:39.412918 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:18:39.412888    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:18:39.415133 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:18:39.414559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:19:39.513942 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:19:39.513913    2573 scope.go:117] "RemoveContainer" containerID="251641c533053da0c3b55ac486e364deb1ea93ebbdc5b05cd67e65dad2ad1888"
Jul 07 22:21:55.186853 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.186767    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"]
Jul 07 22:21:55.187386 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.186980    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf" podUID="6275a69c-20df-486f-b804-b43a8e38c761" containerName="manager" containerID="cri-o://d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace" gracePeriod=10
Jul 07 22:21:55.740040 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.740012    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:21:55.774184 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.774156    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275a69c-20df-486f-b804-b43a8e38c761-extensions-socket-volume\") pod \"6275a69c-20df-486f-b804-b43a8e38c761\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") "
Jul 07 22:21:55.774365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.774254    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff7kk\" (UniqueName: \"kubernetes.io/projected/6275a69c-20df-486f-b804-b43a8e38c761-kube-api-access-ff7kk\") pod \"6275a69c-20df-486f-b804-b43a8e38c761\" (UID: \"6275a69c-20df-486f-b804-b43a8e38c761\") "
Jul 07 22:21:55.774522 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.774500    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6275a69c-20df-486f-b804-b43a8e38c761-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6275a69c-20df-486f-b804-b43a8e38c761" (UID: "6275a69c-20df-486f-b804-b43a8e38c761"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:21:55.776386 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.776363    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6275a69c-20df-486f-b804-b43a8e38c761-kube-api-access-ff7kk" (OuterVolumeSpecName: "kube-api-access-ff7kk") pod "6275a69c-20df-486f-b804-b43a8e38c761" (UID: "6275a69c-20df-486f-b804-b43a8e38c761"). InnerVolumeSpecName "kube-api-access-ff7kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:21:55.786262 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.786220    2573 generic.go:356] "Generic (PLEG): container finished" podID="6275a69c-20df-486f-b804-b43a8e38c761" containerID="d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace" exitCode=0
Jul 07 22:21:55.786403 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.786261    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"
Jul 07 22:21:55.786403 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.786293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf" event={"ID":"6275a69c-20df-486f-b804-b43a8e38c761","Type":"ContainerDied","Data":"d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace"}
Jul 07 22:21:55.786403 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.786353    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf" event={"ID":"6275a69c-20df-486f-b804-b43a8e38c761","Type":"ContainerDied","Data":"81712bbce7b6aaf9ca6c94e693065297083c34e8c38b37bdb5701d856b711a4d"}
Jul 07 22:21:55.786403 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.786383    2573 scope.go:117] "RemoveContainer" containerID="d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace"
Jul 07 22:21:55.800415 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.800378    2573 scope.go:117] "RemoveContainer" containerID="d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace"
Jul 07 22:21:55.800792 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:21:55.800769    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace\": container with ID starting with d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace not found: ID does not exist" containerID="d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace"
Jul 07 22:21:55.800896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.800808    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace"} err="failed to get container status \"d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace\": rpc error: code = NotFound desc = could not find container \"d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace\": container with ID starting with d146562ea097488c859339588e2306f9d38f34c260c7b4f0d5cb5945d3bd6ace not found: ID does not exist"
Jul 07 22:21:55.812449 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.812376    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"]
Jul 07 22:21:55.816714 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.816691    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhkrf"]
Jul 07 22:21:55.875564 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.875532    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275a69c-20df-486f-b804-b43a8e38c761-extensions-socket-volume\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:21:55.875564 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:55.875558    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff7kk\" (UniqueName: \"kubernetes.io/projected/6275a69c-20df-486f-b804-b43a8e38c761-kube-api-access-ff7kk\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:21:57.503782 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:21:57.503749    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6275a69c-20df-486f-b804-b43a8e38c761" path="/var/lib/kubelet/pods/6275a69c-20df-486f-b804-b43a8e38c761/volumes"
Jul 07 22:22:15.633644 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:15.633613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:22:16.953963 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:16.953929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:22:56.305913 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.305875    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"]
Jul 07 22:22:56.306328 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.306293    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6275a69c-20df-486f-b804-b43a8e38c761" containerName="manager"
Jul 07 22:22:56.306328 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.306306    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6275a69c-20df-486f-b804-b43a8e38c761" containerName="manager"
Jul 07 22:22:56.306406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.306387    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6275a69c-20df-486f-b804-b43a8e38c761" containerName="manager"
Jul 07 22:22:56.310470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.310454    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.312774 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.312745    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5xlwb\""
Jul 07 22:22:56.320851 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.320827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"]
Jul 07 22:22:56.398466 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.398426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r529f\" (UniqueName: \"kubernetes.io/projected/b8048158-4d11-4763-8d91-6cdadad2b01f-kube-api-access-r529f\") pod \"kuadrant-operator-controller-manager-86878c769f-2b6zj\" (UID: \"b8048158-4d11-4763-8d91-6cdadad2b01f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.398652 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.398481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8048158-4d11-4763-8d91-6cdadad2b01f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2b6zj\" (UID: \"b8048158-4d11-4763-8d91-6cdadad2b01f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.499427 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.499389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r529f\" (UniqueName: \"kubernetes.io/projected/b8048158-4d11-4763-8d91-6cdadad2b01f-kube-api-access-r529f\") pod \"kuadrant-operator-controller-manager-86878c769f-2b6zj\" (UID: \"b8048158-4d11-4763-8d91-6cdadad2b01f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.499641 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.499440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8048158-4d11-4763-8d91-6cdadad2b01f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2b6zj\" (UID: \"b8048158-4d11-4763-8d91-6cdadad2b01f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.499835 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.499816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8048158-4d11-4763-8d91-6cdadad2b01f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2b6zj\" (UID: \"b8048158-4d11-4763-8d91-6cdadad2b01f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.511131 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.511097    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r529f\" (UniqueName: \"kubernetes.io/projected/b8048158-4d11-4763-8d91-6cdadad2b01f-kube-api-access-r529f\") pod \"kuadrant-operator-controller-manager-86878c769f-2b6zj\" (UID: \"b8048158-4d11-4763-8d91-6cdadad2b01f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.620879 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.620787    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:56.761724 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:56.761700    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"]
Jul 07 22:22:56.763842 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:22:56.763813    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8048158_4d11_4763_8d91_6cdadad2b01f.slice/crio-d94c6566d3f0ff9eb746a1cff96c55b066f30c86b0f54f2df5e5764b01d05652 WatchSource:0}: Error finding container d94c6566d3f0ff9eb746a1cff96c55b066f30c86b0f54f2df5e5764b01d05652: Status 404 returned error can't find the container with id d94c6566d3f0ff9eb746a1cff96c55b066f30c86b0f54f2df5e5764b01d05652
Jul 07 22:22:57.078968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:57.078938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj" event={"ID":"b8048158-4d11-4763-8d91-6cdadad2b01f","Type":"ContainerStarted","Data":"f4603b4b7b755de505112005f4eb8374e3a868fa5207791ee252fa110bb9dcee"}
Jul 07 22:22:57.079148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:57.078987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj" event={"ID":"b8048158-4d11-4763-8d91-6cdadad2b01f","Type":"ContainerStarted","Data":"d94c6566d3f0ff9eb746a1cff96c55b066f30c86b0f54f2df5e5764b01d05652"}
Jul 07 22:22:57.079148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:57.079052    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:22:57.095358 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:22:57.095308    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj" podStartSLOduration=1.09529318 podStartE2EDuration="1.09529318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:22:57.094381715 +0000 UTC m=+1158.104320893" watchObservedRunningTime="2026-07-07 22:22:57.09529318 +0000 UTC m=+1158.105232359"
Jul 07 22:23:08.085968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:23:08.085937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2b6zj"
Jul 07 22:23:39.442547 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:23:39.442406    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:23:39.446455 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:23:39.444857    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:23:44.033565 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:23:44.033523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:24:26.729671 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:24:26.729636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:28:04.156247 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:04.156075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:28:05.332046 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:05.332014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:28:39.472763 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:39.472636    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:28:39.476872 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:39.475869    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:28:39.534354 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:39.534318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:28:44.074700 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:44.074635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:28:52.336067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:52.336027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:28:57.421348 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:28:57.421313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:00.148588 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:00.148510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:00.247993 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:00.247961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:00.587630 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:00.587598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:06.179404 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.179363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:06.281334 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.281301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:06.357855 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.357824    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"]
Jul 07 22:29:06.362051 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.362025    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.364448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.364424    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-76a9d428-openshift-default-dockercfg-56fp6\""
Jul 07 22:29:06.377937 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.377909    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"]
Jul 07 22:29:06.387827 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.387803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:06.412537 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-certs\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412663 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-data\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412663 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-podinfo\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-credential-socket\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412684    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g6g7\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-kube-api-access-6g6g7\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-token\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6ea2247-8061-4413-b600-51d21d4c9f6a-istiod-ca-cert\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-envoy\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.412946 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.412787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-socket\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.487949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.487862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:06.513556 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-credential-socket\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513556 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g6g7\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-kube-api-access-6g6g7\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-token\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6ea2247-8061-4413-b600-51d21d4c9f6a-istiod-ca-cert\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-envoy\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513868 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-socket\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513868 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-certs\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513972 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-data\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513972 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513911    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-podinfo\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.513972 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.513959    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-credential-socket\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.514178 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.514156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-socket\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.514283 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.514256    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-data\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.514429 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.514410    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-certs\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.514494 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.514447    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6ea2247-8061-4413-b600-51d21d4c9f6a-istiod-ca-cert\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.516026 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.516008    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-envoy\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.516477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.516455    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-podinfo\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.520962 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.520937    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-token\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.521041 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.520998    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g6g7\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-kube-api-access-6g6g7\") pod \"e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") " pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.673099 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.673058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:06.812191 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.812163    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"]
Jul 07 22:29:06.814102 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:29:06.814074    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ea2247_8061_4413_b600_51d21d4c9f6a.slice/crio-9fb108fad407a3d082c93b46b573d3330cc45cf43c926171ea79d8358fc12af3 WatchSource:0}: Error finding container 9fb108fad407a3d082c93b46b573d3330cc45cf43c926171ea79d8358fc12af3: Status 404 returned error can't find the container with id 9fb108fad407a3d082c93b46b573d3330cc45cf43c926171ea79d8358fc12af3
Jul 07 22:29:06.816268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.816234    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:29:06.816348 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.816310    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:29:06.816386 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.816359    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:29:06.892395 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.892365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9" event={"ID":"f6ea2247-8061-4413-b600-51d21d4c9f6a","Type":"ContainerStarted","Data":"c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def"}
Jul 07 22:29:06.892551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.892422    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9" event={"ID":"f6ea2247-8061-4413-b600-51d21d4c9f6a","Type":"ContainerStarted","Data":"9fb108fad407a3d082c93b46b573d3330cc45cf43c926171ea79d8358fc12af3"}
Jul 07 22:29:06.911465 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:06.911416    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9" podStartSLOduration=0.91139919 podStartE2EDuration="911.39919ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:29:06.90864303 +0000 UTC m=+1527.918582212" watchObservedRunningTime="2026-07-07 22:29:06.91139919 +0000 UTC m=+1527.921338367"
Jul 07 22:29:07.486084 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.486048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:07.582470 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.582434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:07.673829 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.673793    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:07.678705 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.678681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:07.710741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.710703    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"]
Jul 07 22:29:07.714794 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.714771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.716883 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.716867    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-76a9d428-serving-cert\""
Jul 07 22:29:07.721968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.721943    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"]
Jul 07 22:29:07.725353 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.725190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdc7\" (UniqueName: \"kubernetes.io/projected/3a36aa0d-0999-4df0-a120-2910d01cba98-kube-api-access-fsdc7\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.725572 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.725553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.725737 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.725719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aa0d-0999-4df0-a120-2910d01cba98-openshift-service-ca\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.747163 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.747091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:07.826526 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.826496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.826702 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.826536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aa0d-0999-4df0-a120-2910d01cba98-openshift-service-ca\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.826702 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.826610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdc7\" (UniqueName: \"kubernetes.io/projected/3a36aa0d-0999-4df0-a120-2910d01cba98-kube-api-access-fsdc7\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.826702 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:07.826679    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-76a9d428-serving-cert: secret "maas-api-e2e-ait-76a9d428-serving-cert" not found
Jul 07 22:29:07.826812 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:07.826755    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls podName:3a36aa0d-0999-4df0-a120-2910d01cba98 nodeName:}" failed. No retries permitted until 2026-07-07 22:29:08.326733006 +0000 UTC m=+1529.336672163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls") pod "maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v" (UID: "3a36aa0d-0999-4df0-a120-2910d01cba98") : secret "maas-api-e2e-ait-76a9d428-serving-cert" not found
Jul 07 22:29:07.827181 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.827163    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aa0d-0999-4df0-a120-2910d01cba98-openshift-service-ca\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.837310 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.837286    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdc7\" (UniqueName: \"kubernetes.io/projected/3a36aa0d-0999-4df0-a120-2910d01cba98-kube-api-access-fsdc7\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:07.897931 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.897897    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:07.898740 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.898722    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:07.983786 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:07.983752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:08.130901 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.130866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:08.236442 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.236408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:08.332774 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.332738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:08.335411 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.335385    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls\") pod \"maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") " pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:08.629067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.629027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:08.773717 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.773693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"]
Jul 07 22:29:08.775995 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:29:08.775954    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a36aa0d_0999_4df0_a120_2910d01cba98.slice/crio-d292e70d42903fc1a2ee6468273f119171263ee46a7e54547eba2b52875accae WatchSource:0}: Error finding container d292e70d42903fc1a2ee6468273f119171263ee46a7e54547eba2b52875accae: Status 404 returned error can't find the container with id d292e70d42903fc1a2ee6468273f119171263ee46a7e54547eba2b52875accae
Jul 07 22:29:08.777419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.777401    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:29:08.904997 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:08.904903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v" event={"ID":"3a36aa0d-0999-4df0-a120-2910d01cba98","Type":"ContainerStarted","Data":"d292e70d42903fc1a2ee6468273f119171263ee46a7e54547eba2b52875accae"}
Jul 07 22:29:09.775824 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:09.775785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:09.911843 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:09.911804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v" event={"ID":"3a36aa0d-0999-4df0-a120-2910d01cba98","Type":"ContainerStarted","Data":"aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2"}
Jul 07 22:29:09.928870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:09.928823    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v" podStartSLOduration=2.271999193 podStartE2EDuration="2.928807652s" totalImagesPullingTime="656.808459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:29:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:29:09.926877343 +0000 UTC m=+1530.936816520" watchObservedRunningTime="2026-07-07 22:29:09.928807652 +0000 UTC m=+1530.938746830"
Jul 07 22:29:10.916704 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:10.916676    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:12.638220 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:12.638164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:12.784059 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:12.784025    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"]
Jul 07 22:29:12.784301 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:12.784238    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9" podUID="f6ea2247-8061-4413-b600-51d21d4c9f6a" containerName="istio-proxy" containerID="cri-o://c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def" gracePeriod=30
Jul 07 22:29:12.805468 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:12.805432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:13.000868 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.000823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:13.095105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.094849    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"]
Jul 07 22:29:13.095105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.095036    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v" podUID="3a36aa0d-0999-4df0-a120-2910d01cba98" containerName="maas-api" containerID="cri-o://aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2" gracePeriod=30
Jul 07 22:29:13.101948 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.101923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:13.390079 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.390051    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:13.394177 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.394146    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls\") pod \"3a36aa0d-0999-4df0-a120-2910d01cba98\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") "
Jul 07 22:29:13.394316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.394215    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsdc7\" (UniqueName: \"kubernetes.io/projected/3a36aa0d-0999-4df0-a120-2910d01cba98-kube-api-access-fsdc7\") pod \"3a36aa0d-0999-4df0-a120-2910d01cba98\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") "
Jul 07 22:29:13.394316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.394246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aa0d-0999-4df0-a120-2910d01cba98-openshift-service-ca\") pod \"3a36aa0d-0999-4df0-a120-2910d01cba98\" (UID: \"3a36aa0d-0999-4df0-a120-2910d01cba98\") "
Jul 07 22:29:13.394588 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.394568    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a36aa0d-0999-4df0-a120-2910d01cba98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a36aa0d-0999-4df0-a120-2910d01cba98" (UID: "3a36aa0d-0999-4df0-a120-2910d01cba98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:29:13.396409 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.396389    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a36aa0d-0999-4df0-a120-2910d01cba98-kube-api-access-fsdc7" (OuterVolumeSpecName: "kube-api-access-fsdc7") pod "3a36aa0d-0999-4df0-a120-2910d01cba98" (UID: "3a36aa0d-0999-4df0-a120-2910d01cba98"). InnerVolumeSpecName "kube-api-access-fsdc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:29:13.396539 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.396521    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a36aa0d-0999-4df0-a120-2910d01cba98" (UID: "3a36aa0d-0999-4df0-a120-2910d01cba98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:29:13.495729 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.495681    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsdc7\" (UniqueName: \"kubernetes.io/projected/3a36aa0d-0999-4df0-a120-2910d01cba98-kube-api-access-fsdc7\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:13.495729 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.495721    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aa0d-0999-4df0-a120-2910d01cba98-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:13.495729 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.495732    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36aa0d-0999-4df0-a120-2910d01cba98-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:13.935370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.935337    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a36aa0d-0999-4df0-a120-2910d01cba98" containerID="aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2" exitCode=0
Jul 07 22:29:13.935874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.935383    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"
Jul 07 22:29:13.935874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.935418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v" event={"ID":"3a36aa0d-0999-4df0-a120-2910d01cba98","Type":"ContainerDied","Data":"aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2"}
Jul 07 22:29:13.935874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.935516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v" event={"ID":"3a36aa0d-0999-4df0-a120-2910d01cba98","Type":"ContainerDied","Data":"d292e70d42903fc1a2ee6468273f119171263ee46a7e54547eba2b52875accae"}
Jul 07 22:29:13.935874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.935550    2573 scope.go:117] "RemoveContainer" containerID="aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2"
Jul 07 22:29:13.944274 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.944250    2573 scope.go:117] "RemoveContainer" containerID="aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2"
Jul 07 22:29:13.944554 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:13.944532    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2\": container with ID starting with aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2 not found: ID does not exist" containerID="aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2"
Jul 07 22:29:13.944657 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.944561    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2"} err="failed to get container status \"aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2\": rpc error: code = NotFound desc = could not find container \"aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2\": container with ID starting with aadb5155411403cd8a1c7bd1077e6c60dca5bb7d401249341c6ed2d4d4e489d2 not found: ID does not exist"
Jul 07 22:29:13.955221 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.952530    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"]
Jul 07 22:29:13.959638 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:13.959607    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-76a9d428-7bfdf5df74-2jb7v"]
Jul 07 22:29:14.818483 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:14.818449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:15.505345 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:15.505307    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a36aa0d-0999-4df0-a120-2910d01cba98" path="/var/lib/kubelet/pods/3a36aa0d-0999-4df0-a120-2910d01cba98/volumes"
Jul 07 22:29:18.597265 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.597231    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:18.698067 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.698037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:18.749651 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.749626    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:18.816741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.816667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:18.840313 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840277    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-token\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840469 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-certs\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840469 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840398    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-credential-socket\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840469 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840431    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-podinfo\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840475    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-envoy\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840500    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-data\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6ea2247-8061-4413-b600-51d21d4c9f6a-istiod-ca-cert\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840574    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-socket\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840627    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g6g7\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-kube-api-access-6g6g7\") pod \"f6ea2247-8061-4413-b600-51d21d4c9f6a\" (UID: \"f6ea2247-8061-4413-b600-51d21d4c9f6a\") "
Jul 07 22:29:18.840885 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840681    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:18.840885 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840704    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:18.841159 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840896    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:18.841159 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840971    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6ea2247-8061-4413-b600-51d21d4c9f6a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:29:18.841159 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.840998    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-certs\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.841159 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.841014    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-credential-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.841527 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.841504    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:18.842627 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.842604    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:29:18.842743 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.842719    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:18.843179 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.843158    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:29:18.843260 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.843175    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-kube-api-access-6g6g7" (OuterVolumeSpecName: "kube-api-access-6g6g7") pod "f6ea2247-8061-4413-b600-51d21d4c9f6a" (UID: "f6ea2247-8061-4413-b600-51d21d4c9f6a"). InnerVolumeSpecName "kube-api-access-6g6g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:29:18.874040 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.874006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:18.942246 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.942191    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6ea2247-8061-4413-b600-51d21d4c9f6a-istiod-ca-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.942246 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.942244    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-workload-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.942458 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.942256    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g6g7\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-kube-api-access-6g6g7\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.942458 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.942271    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-token\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.942458 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.942281    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-podinfo\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.942458 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.942292    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-envoy\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.942458 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.942302    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6ea2247-8061-4413-b600-51d21d4c9f6a-istio-data\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:18.972634 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.972600    2573 generic.go:356] "Generic (PLEG): container finished" podID="f6ea2247-8061-4413-b600-51d21d4c9f6a" containerID="c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def" exitCode=0
Jul 07 22:29:18.972826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.972651    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"
Jul 07 22:29:18.972826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.972667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9" event={"ID":"f6ea2247-8061-4413-b600-51d21d4c9f6a","Type":"ContainerDied","Data":"c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def"}
Jul 07 22:29:18.972826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.972721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9" event={"ID":"f6ea2247-8061-4413-b600-51d21d4c9f6a","Type":"ContainerDied","Data":"9fb108fad407a3d082c93b46b573d3330cc45cf43c926171ea79d8358fc12af3"}
Jul 07 22:29:18.972826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.972750    2573 scope.go:117] "RemoveContainer" containerID="c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def"
Jul 07 22:29:18.982460 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.982443    2573 scope.go:117] "RemoveContainer" containerID="c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def"
Jul 07 22:29:18.982715 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:18.982697    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def\": container with ID starting with c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def not found: ID does not exist" containerID="c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def"
Jul 07 22:29:18.982762 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.982723    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def"} err="failed to get container status \"c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def\": rpc error: code = NotFound desc = could not find container \"c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def\": container with ID starting with c1453e78304cc6e10564babf1e186c031e5d11581b4b420480885c4c92c84def not found: ID does not exist"
Jul 07 22:29:18.993602 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.993579    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"]
Jul 07 22:29:18.997123 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:18.997101    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-76a9d428-openshift-default-66d9675cf7-v8xg9"]
Jul 07 22:29:19.505642 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:19.505611    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ea2247-8061-4413-b600-51d21d4c9f6a" path="/var/lib/kubelet/pods/f6ea2247-8061-4413-b600-51d21d4c9f6a/volumes"
Jul 07 22:29:19.992209 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:19.992091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:20.054823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.052404    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"]
Jul 07 22:29:20.054823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.053021    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ea2247-8061-4413-b600-51d21d4c9f6a" containerName="istio-proxy"
Jul 07 22:29:20.054823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.053038    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ea2247-8061-4413-b600-51d21d4c9f6a" containerName="istio-proxy"
Jul 07 22:29:20.054823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.053050    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a36aa0d-0999-4df0-a120-2910d01cba98" containerName="maas-api"
Jul 07 22:29:20.054823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.053058    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a36aa0d-0999-4df0-a120-2910d01cba98" containerName="maas-api"
Jul 07 22:29:20.054823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.053160    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ea2247-8061-4413-b600-51d21d4c9f6a" containerName="istio-proxy"
Jul 07 22:29:20.054823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.053175    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a36aa0d-0999-4df0-a120-2910d01cba98" containerName="maas-api"
Jul 07 22:29:20.056850 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.056771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.059111 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.059086    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-86400e9a-serving-cert\""
Jul 07 22:29:20.064937 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.064909    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"]
Jul 07 22:29:20.069340 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.069313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:20.145887 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.145856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:20.152979 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.152950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-openshift-service-ca\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.153107 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.153016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbmg\" (UniqueName: \"kubernetes.io/projected/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-kube-api-access-knbmg\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.153170 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.153095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-maas-api-tls\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.248035 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.247888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:20.254551 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.254519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-openshift-service-ca\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.254708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.254610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knbmg\" (UniqueName: \"kubernetes.io/projected/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-kube-api-access-knbmg\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.254708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.254636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-maas-api-tls\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.255400 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.255365    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-openshift-service-ca\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.257419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.257397    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-maas-api-tls\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.263885 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.263855    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbmg\" (UniqueName: \"kubernetes.io/projected/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-kube-api-access-knbmg\") pod \"maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") " pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.369884 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.369852    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:20.510761 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.510736    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"]
Jul 07 22:29:20.635366 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.635335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:20.736330 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.736298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:20.985643 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.985611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l" event={"ID":"65e07407-83f4-42c6-be88-b3f7fa3bd0d7","Type":"ContainerStarted","Data":"9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880"}
Jul 07 22:29:20.985828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.985665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l" event={"ID":"65e07407-83f4-42c6-be88-b3f7fa3bd0d7","Type":"ContainerStarted","Data":"396b2c80e72ac8abc8e21ae823b5d1cedecf7cf840f29555a2f9bbccb536ebe4"}
Jul 07 22:29:20.985828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:20.985799    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:21.001568 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:21.001516    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l" podStartSLOduration=0.653507171 podStartE2EDuration="1.001500937s" totalImagesPullingTime="347.993766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:29:21.000329962 +0000 UTC m=+1542.010269161" watchObservedRunningTime="2026-07-07 22:29:21.001500937 +0000 UTC m=+1542.011440115"
Jul 07 22:29:22.206374 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:22.206340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:24.999680 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:24.999649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:25.283359 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.283273    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"]
Jul 07 22:29:25.283663 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.283624    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l" podUID="65e07407-83f4-42c6-be88-b3f7fa3bd0d7" containerName="maas-api" containerID="cri-o://9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880" gracePeriod=30
Jul 07 22:29:25.290366 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.290345    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:25.306574 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.306534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:25.525341 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.525318    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:25.604957 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.604863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knbmg\" (UniqueName: \"kubernetes.io/projected/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-kube-api-access-knbmg\") pod \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") "
Jul 07 22:29:25.604957 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.604946    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-openshift-service-ca\") pod \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") "
Jul 07 22:29:25.605190 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.604975    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-maas-api-tls\") pod \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\" (UID: \"65e07407-83f4-42c6-be88-b3f7fa3bd0d7\") "
Jul 07 22:29:25.605393 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.605370    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65e07407-83f4-42c6-be88-b3f7fa3bd0d7" (UID: "65e07407-83f4-42c6-be88-b3f7fa3bd0d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:29:25.607191 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.607165    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65e07407-83f4-42c6-be88-b3f7fa3bd0d7" (UID: "65e07407-83f4-42c6-be88-b3f7fa3bd0d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:29:25.607316 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.607241    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-kube-api-access-knbmg" (OuterVolumeSpecName: "kube-api-access-knbmg") pod "65e07407-83f4-42c6-be88-b3f7fa3bd0d7" (UID: "65e07407-83f4-42c6-be88-b3f7fa3bd0d7"). InnerVolumeSpecName "kube-api-access-knbmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:29:25.706192 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.706160    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knbmg\" (UniqueName: \"kubernetes.io/projected/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-kube-api-access-knbmg\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:25.706192 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.706185    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:25.706192 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:25.706216    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e07407-83f4-42c6-be88-b3f7fa3bd0d7-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:26.040106 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.040073    2573 generic.go:356] "Generic (PLEG): container finished" podID="65e07407-83f4-42c6-be88-b3f7fa3bd0d7" containerID="9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880" exitCode=0
Jul 07 22:29:26.040531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.040119    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"
Jul 07 22:29:26.040531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.040167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l" event={"ID":"65e07407-83f4-42c6-be88-b3f7fa3bd0d7","Type":"ContainerDied","Data":"9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880"}
Jul 07 22:29:26.040531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.040241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l" event={"ID":"65e07407-83f4-42c6-be88-b3f7fa3bd0d7","Type":"ContainerDied","Data":"396b2c80e72ac8abc8e21ae823b5d1cedecf7cf840f29555a2f9bbccb536ebe4"}
Jul 07 22:29:26.040531 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.040265    2573 scope.go:117] "RemoveContainer" containerID="9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880"
Jul 07 22:29:26.050244 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.050226    2573 scope.go:117] "RemoveContainer" containerID="9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880"
Jul 07 22:29:26.050512 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:26.050495    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880\": container with ID starting with 9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880 not found: ID does not exist" containerID="9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880"
Jul 07 22:29:26.050585 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.050525    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880"} err="failed to get container status \"9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880\": rpc error: code = NotFound desc = could not find container \"9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880\": container with ID starting with 9ef0adce61e8b618b213d80ba473eb13c5bb6cf69323cbc37120f5a1619ea880 not found: ID does not exist"
Jul 07 22:29:26.061627 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.061598    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"]
Jul 07 22:29:26.066258 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:26.066181    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-86400e9a-8c7d5994d-5q92l"]
Jul 07 22:29:27.504297 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:27.504265    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65e07407-83f4-42c6-be88-b3f7fa3bd0d7" path="/var/lib/kubelet/pods/65e07407-83f4-42c6-be88-b3f7fa3bd0d7/volumes"
Jul 07 22:29:31.075365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:31.075332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:31.189640 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:31.189609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:33.368539 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:33.368504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:36.904916 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:36.904874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:37.008086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.008059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:37.090980 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.090939    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"]
Jul 07 22:29:37.091486 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.091467    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e07407-83f4-42c6-be88-b3f7fa3bd0d7" containerName="maas-api"
Jul 07 22:29:37.091597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.091491    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e07407-83f4-42c6-be88-b3f7fa3bd0d7" containerName="maas-api"
Jul 07 22:29:37.091597 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.091574    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e07407-83f4-42c6-be88-b3f7fa3bd0d7" containerName="maas-api"
Jul 07 22:29:37.094370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.094333    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.097979 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.097955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d8633de7-openshift-default-dockercfg-77d46\""
Jul 07 22:29:37.136292 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.136259    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"]
Jul 07 22:29:37.169005 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.168913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:37.215071 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-socket\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215282 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-token\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215282 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istiod-ca-cert\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215282 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8284v\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-kube-api-access-8284v\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215282 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-credential-socket\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215282 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-envoy\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215462 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-certs\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215462 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-data\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.215462 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.215346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-podinfo\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.294365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.294330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:37.315791 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.315760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-socket\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.315934 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.315809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-token\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.315934 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.315828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istiod-ca-cert\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.315934 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.315862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8284v\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-kube-api-access-8284v\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.315934 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.315906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-credential-socket\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.315948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-envoy\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.315988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-certs\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.316015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-data\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316165 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.316061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-podinfo\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.316354    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-credential-socket\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.316361    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-socket\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.316391    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-certs\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316566 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.316471    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-data\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.316623 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.316573    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istiod-ca-cert\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.318685 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.318659    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-envoy\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.318874 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.318859    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-podinfo\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.323780 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.323757    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-token\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.323907 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.323880    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8284v\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-kube-api-access-8284v\") pod \"e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") " pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.404681 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.404638    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:37.544618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.544595    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"]
Jul 07 22:29:37.546552 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:29:37.546527    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdd03fa_1ba5_44ef_ac1c_0943e0da91ac.slice/crio-7c523eee24c5a90d1c22065a4b60cba056271945a926f4630f1027384d2073bb WatchSource:0}: Error finding container 7c523eee24c5a90d1c22065a4b60cba056271945a926f4630f1027384d2073bb: Status 404 returned error can't find the container with id 7c523eee24c5a90d1c22065a4b60cba056271945a926f4630f1027384d2073bb
Jul 07 22:29:37.548686 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.548656    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:29:37.548770 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.548717    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:29:37.548770 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:37.548748    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:29:38.105857 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.105820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9" event={"ID":"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac","Type":"ContainerStarted","Data":"0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557"}
Jul 07 22:29:38.106268 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.105877    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9" event={"ID":"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac","Type":"ContainerStarted","Data":"7c523eee24c5a90d1c22065a4b60cba056271945a926f4630f1027384d2073bb"}
Jul 07 22:29:38.125997 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.125948    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9" podStartSLOduration=1.125931773 podStartE2EDuration="1.125931773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:29:38.12391195 +0000 UTC m=+1559.133851139" watchObservedRunningTime="2026-07-07 22:29:38.125931773 +0000 UTC m=+1559.135870951"
Jul 07 22:29:38.321916 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.321863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:38.390017 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.389933    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"]
Jul 07 22:29:38.393710 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.393687    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.395898 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.395875    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-d8633de7-serving-cert\""
Jul 07 22:29:38.405086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.405066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:38.406707 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.406683    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"]
Jul 07 22:29:38.410666 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.410636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:38.411347 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.411327    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:38.472313 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.472274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:38.528791 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.528761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzbdp\" (UniqueName: \"kubernetes.io/projected/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-kube-api-access-kzbdp\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.528991 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.528805    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-openshift-service-ca\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.528991 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.528888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.630018 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.629968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzbdp\" (UniqueName: \"kubernetes.io/projected/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-kube-api-access-kzbdp\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.630275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.630032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-openshift-service-ca\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.630275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.630092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.630275 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:38.630267    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-d8633de7-serving-cert: secret "maas-api-e2e-derive-d8633de7-serving-cert" not found
Jul 07 22:29:38.630469 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:38.630340    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls podName:f1869b05-3a3d-4e2b-b3c5-9c235afd126a nodeName:}" failed. No retries permitted until 2026-07-07 22:29:39.130317558 +0000 UTC m=+1560.140256717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls") pod "maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l" (UID: "f1869b05-3a3d-4e2b-b3c5-9c235afd126a") : secret "maas-api-e2e-derive-d8633de7-serving-cert" not found
Jul 07 22:29:38.630729 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.630708    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-openshift-service-ca\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.648077 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.642053    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzbdp\" (UniqueName: \"kubernetes.io/projected/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-kube-api-access-kzbdp\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:38.735797 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.735762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:38.968644 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:38.968544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:39.068783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:39.068756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:39.115026 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:39.114993    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:39.116028 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:39.115998    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:39.134358 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:39.134323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:39.136895 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:39.136864    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls\") pod \"maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") " pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:39.304711 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:39.304671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:39.449341 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:39.449315    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"]
Jul 07 22:29:39.450849 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:29:39.450812    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1869b05_3a3d_4e2b_b3c5_9c235afd126a.slice/crio-2081a701d248c9e6eca3d7437b183f161844574e65d92c1561a1b32fb5d60c40 WatchSource:0}: Error finding container 2081a701d248c9e6eca3d7437b183f161844574e65d92c1561a1b32fb5d60c40: Status 404 returned error can't find the container with id 2081a701d248c9e6eca3d7437b183f161844574e65d92c1561a1b32fb5d60c40
Jul 07 22:29:40.120655 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:40.120617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l" event={"ID":"f1869b05-3a3d-4e2b-b3c5-9c235afd126a","Type":"ContainerStarted","Data":"e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b"}
Jul 07 22:29:40.121081 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:40.120679    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l" event={"ID":"f1869b05-3a3d-4e2b-b3c5-9c235afd126a","Type":"ContainerStarted","Data":"2081a701d248c9e6eca3d7437b183f161844574e65d92c1561a1b32fb5d60c40"}
Jul 07 22:29:40.121081 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:40.120836    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:40.137451 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:40.137394    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l" podStartSLOduration=1.834781859 podStartE2EDuration="2.13737936s" totalImagesPullingTime="302.597501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:29:40.135596731 +0000 UTC m=+1561.145535916" watchObservedRunningTime="2026-07-07 22:29:40.13737936 +0000 UTC m=+1561.147318555"
Jul 07 22:29:40.253080 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:40.252861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:42.699694 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:42.699654    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:42.858947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:42.858906    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"]
Jul 07 22:29:42.859222 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:42.859168    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9" podUID="3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" containerName="istio-proxy" containerID="cri-o://0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557" gracePeriod=30
Jul 07 22:29:42.883346 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:42.883316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:42.977481 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:42.977389    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:43.081396 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.081365    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"]
Jul 07 22:29:43.081616 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.081575    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l" podUID="f1869b05-3a3d-4e2b-b3c5-9c235afd126a" containerName="maas-api" containerID="cri-o://e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b" gracePeriod=30
Jul 07 22:29:43.107251 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.107220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:43.337823 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.337797    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:43.477999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.477966    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls\") pod \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") "
Jul 07 22:29:43.478173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.478022    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-openshift-service-ca\") pod \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") "
Jul 07 22:29:43.478173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.478053    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzbdp\" (UniqueName: \"kubernetes.io/projected/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-kube-api-access-kzbdp\") pod \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\" (UID: \"f1869b05-3a3d-4e2b-b3c5-9c235afd126a\") "
Jul 07 22:29:43.478435 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.478408    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f1869b05-3a3d-4e2b-b3c5-9c235afd126a" (UID: "f1869b05-3a3d-4e2b-b3c5-9c235afd126a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:29:43.480452 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.480417    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-kube-api-access-kzbdp" (OuterVolumeSpecName: "kube-api-access-kzbdp") pod "f1869b05-3a3d-4e2b-b3c5-9c235afd126a" (UID: "f1869b05-3a3d-4e2b-b3c5-9c235afd126a"). InnerVolumeSpecName "kube-api-access-kzbdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:29:43.480452 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.480435    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f1869b05-3a3d-4e2b-b3c5-9c235afd126a" (UID: "f1869b05-3a3d-4e2b-b3c5-9c235afd126a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:29:43.579502 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.579460    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzbdp\" (UniqueName: \"kubernetes.io/projected/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-kube-api-access-kzbdp\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:43.579502 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.579505    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:43.579774 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:43.579520    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1869b05-3a3d-4e2b-b3c5-9c235afd126a-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:44.148606 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.148571    2573 generic.go:356] "Generic (PLEG): container finished" podID="f1869b05-3a3d-4e2b-b3c5-9c235afd126a" containerID="e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b" exitCode=0
Jul 07 22:29:44.149076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.148622    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"
Jul 07 22:29:44.149076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.148660    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l" event={"ID":"f1869b05-3a3d-4e2b-b3c5-9c235afd126a","Type":"ContainerDied","Data":"e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b"}
Jul 07 22:29:44.149076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.148716    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l" event={"ID":"f1869b05-3a3d-4e2b-b3c5-9c235afd126a","Type":"ContainerDied","Data":"2081a701d248c9e6eca3d7437b183f161844574e65d92c1561a1b32fb5d60c40"}
Jul 07 22:29:44.149076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.148742    2573 scope.go:117] "RemoveContainer" containerID="e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b"
Jul 07 22:29:44.157821 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.157802    2573 scope.go:117] "RemoveContainer" containerID="e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b"
Jul 07 22:29:44.158080 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:44.158059    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b\": container with ID starting with e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b not found: ID does not exist" containerID="e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b"
Jul 07 22:29:44.158140 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.158092    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b"} err="failed to get container status \"e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b\": rpc error: code = NotFound desc = could not find container \"e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b\": container with ID starting with e35a8b220a5861f09a538d0fe8c599db99e760e9a553c744e4323c2b6619912b not found: ID does not exist"
Jul 07 22:29:44.165034 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.165002    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"]
Jul 07 22:29:44.167989 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:44.167967    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-d8633de7-54475bb47b-qvd2l"]
Jul 07 22:29:45.504058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:45.504024    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1869b05-3a3d-4e2b-b3c5-9c235afd126a" path="/var/lib/kubelet/pods/f1869b05-3a3d-4e2b-b3c5-9c235afd126a/volumes"
Jul 07 22:29:46.388759 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:46.388730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:48.118832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.118808    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:48.171741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.171659    2573 generic.go:356] "Generic (PLEG): container finished" podID="3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" containerID="0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557" exitCode=0
Jul 07 22:29:48.171741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.171706    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"
Jul 07 22:29:48.171741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.171735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9" event={"ID":"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac","Type":"ContainerDied","Data":"0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557"}
Jul 07 22:29:48.171942 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.171786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9" event={"ID":"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac","Type":"ContainerDied","Data":"7c523eee24c5a90d1c22065a4b60cba056271945a926f4630f1027384d2073bb"}
Jul 07 22:29:48.171942 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.171814    2573 scope.go:117] "RemoveContainer" containerID="0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557"
Jul 07 22:29:48.180361 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.180345    2573 scope.go:117] "RemoveContainer" containerID="0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557"
Jul 07 22:29:48.180632 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:29:48.180609    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557\": container with ID starting with 0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557 not found: ID does not exist" containerID="0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557"
Jul 07 22:29:48.180676 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.180641    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557"} err="failed to get container status \"0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557\": rpc error: code = NotFound desc = could not find container \"0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557\": container with ID starting with 0752377f18ce75c3b7e23760e1f7220ee369dc4a76dcf77aedf5b4390a732557 not found: ID does not exist"
Jul 07 22:29:48.227953 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.227921    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-certs\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.227964    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istiod-ca-cert\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228009    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-credential-socket\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228034    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8284v\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-kube-api-access-8284v\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228080    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-podinfo\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-socket\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228157    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-data\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228241    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-token\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-envoy\") pod \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\" (UID: \"3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac\") "
Jul 07 22:29:48.228405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228282    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:48.228405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228386    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:48.228618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228436    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:29:48.228618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228557    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:48.228727 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228687    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:48.228900 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228845    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-certs\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.228900 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228864    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istiod-ca-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.228900 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228872    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-credential-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.228900 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228881    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-workload-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.228900 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.228889    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-data\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.230554 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.230522    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:29:48.230711 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.230689    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:29:48.230974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.230951    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-kube-api-access-8284v" (OuterVolumeSpecName: "kube-api-access-8284v") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "kube-api-access-8284v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:29:48.230974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.230952    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" (UID: "3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:29:48.329927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.329885    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8284v\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-kube-api-access-8284v\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.329927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.329921    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-podinfo\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.329927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.329931    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-token\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.329927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.329939    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac-istio-envoy\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:29:48.498580 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.498544    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"]
Jul 07 22:29:48.502229 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.502191    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d8633de7-openshift-default-6d8c8958c9-r7pc9"]
Jul 07 22:29:48.705713 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.705677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:48.803927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:48.803893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:49.163437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:49.163333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:49.264973 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:49.264939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:49.369985 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:49.369948    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:49.505163 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:49.505128    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" path="/var/lib/kubelet/pods/3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac/volumes"
Jul 07 22:29:50.710239 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:50.710210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:56.269070 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:56.269031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:56.332777 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:56.332740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:56.418120 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:56.418088    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:56.515296 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:56.515259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:56.615187 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:56.615093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:29:56.966783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:29:56.966705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:12.814963 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:12.814920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:12.915373 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:12.915338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:22.940388 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:22.940355    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:28.560675 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:28.560633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:28.667545 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:28.667518    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:28.760258 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:28.760179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:44.646892 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:44.646855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:50.286615 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:50.286578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:50.349265 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:50.349225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:30:50.427323 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:30:50.427284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:00.976886 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:00.976847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:01.774951 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:01.774920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:07.437297 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:07.437261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:07.540248 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:07.540191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:07.636666 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:07.636632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:07.689405 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:07.689317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:08.483259 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:08.483217    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:08.585510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:08.585474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:08.687390 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:08.687356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:10.239932 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:10.239893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:15.829343 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:15.829307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:15.886968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:15.886924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:16.501242 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:16.501178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:22.156378 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:22.156341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:22.257860 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:22.257828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:22.385615 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:22.385584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:22.696550 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:22.696517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:22.816731 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:22.816697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:26.009942 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.009903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:26.068111 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.068078    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"]
Jul 07 22:31:26.068951 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.068926    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1869b05-3a3d-4e2b-b3c5-9c235afd126a" containerName="maas-api"
Jul 07 22:31:26.068951 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.068954    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1869b05-3a3d-4e2b-b3c5-9c235afd126a" containerName="maas-api"
Jul 07 22:31:26.069093 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.068981    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" containerName="istio-proxy"
Jul 07 22:31:26.069093 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.068990    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" containerName="istio-proxy"
Jul 07 22:31:26.069093 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.069089    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdd03fa-1ba5-44ef-ac1c-0943e0da91ac" containerName="istio-proxy"
Jul 07 22:31:26.069220 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.069099    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1869b05-3a3d-4e2b-b3c5-9c235afd126a" containerName="maas-api"
Jul 07 22:31:26.072706 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.072683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.074974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.074948    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ac5ac682-serving-cert\""
Jul 07 22:31:26.084936 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.084915    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"]
Jul 07 22:31:26.102459 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.102434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:26.178173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.178137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:26.224251 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.224188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-maas-api-tls\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.224436 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.224261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkz2q\" (UniqueName: \"kubernetes.io/projected/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-kube-api-access-dkz2q\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.224436 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.224328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-openshift-service-ca\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.277879 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.277789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:26.324806 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.324769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkz2q\" (UniqueName: \"kubernetes.io/projected/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-kube-api-access-dkz2q\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.324983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.324817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-openshift-service-ca\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.324983 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.324886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-maas-api-tls\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.325508 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.325488    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-openshift-service-ca\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.327460 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.327443    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-maas-api-tls\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.334275 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.334249    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkz2q\" (UniqueName: \"kubernetes.io/projected/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-kube-api-access-dkz2q\") pod \"maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") " pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.378000 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.377944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:26.385921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.385893    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:26.541510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.541454    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"]
Jul 07 22:31:26.543875 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:31:26.543849    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6fd5455_c909_4e5f_88d9_cf8fba87e3bf.slice/crio-e02820056c53fb01951fa5a0c7369def0cb61d4ed8aa009e0580be34e8228ed3 WatchSource:0}: Error finding container e02820056c53fb01951fa5a0c7369def0cb61d4ed8aa009e0580be34e8228ed3: Status 404 returned error can't find the container with id e02820056c53fb01951fa5a0c7369def0cb61d4ed8aa009e0580be34e8228ed3
Jul 07 22:31:26.645571 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.645542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:26.658569 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.658534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh" event={"ID":"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf","Type":"ContainerStarted","Data":"e02820056c53fb01951fa5a0c7369def0cb61d4ed8aa009e0580be34e8228ed3"}
Jul 07 22:31:26.769213 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:26.769163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:27.665332 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:27.665295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh" event={"ID":"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf","Type":"ContainerStarted","Data":"89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55"}
Jul 07 22:31:27.665795 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:27.665382    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:27.684801 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:27.684750    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh" podStartSLOduration=0.994182629 podStartE2EDuration="1.68473382s" totalImagesPullingTime="690.551191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:31:27.683048912 +0000 UTC m=+1668.692988080" watchObservedRunningTime="2026-07-07 22:31:27.68473382 +0000 UTC m=+1668.694673030"
Jul 07 22:31:30.511016 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:30.510984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:31.144628 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:31.144595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:31.245535 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:31.245505    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:33.675862 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:33.675832    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:36.578161 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:36.578128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:42.367901 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:42.367871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:42.431350 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:42.431319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:42.781573 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:42.781537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:43.075373 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.075286    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"]
Jul 07 22:31:43.075839 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.075805    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh" podUID="d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" containerName="maas-api" containerID="cri-o://89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55" gracePeriod=30
Jul 07 22:31:43.111059 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.111029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:43.211870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.211828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:43.325628 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.325564    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:43.376541 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.376512    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-openshift-service-ca\") pod \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") "
Jul 07 22:31:43.376976 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.376559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkz2q\" (UniqueName: \"kubernetes.io/projected/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-kube-api-access-dkz2q\") pod \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") "
Jul 07 22:31:43.376976 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.376622    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-maas-api-tls\") pod \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\" (UID: \"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf\") "
Jul 07 22:31:43.376976 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.376861    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" (UID: "d6fd5455-c909-4e5f-88d9-cf8fba87e3bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:31:43.378799 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.378774    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" (UID: "d6fd5455-c909-4e5f-88d9-cf8fba87e3bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:31:43.378886 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.378853    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-kube-api-access-dkz2q" (OuterVolumeSpecName: "kube-api-access-dkz2q") pod "d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" (UID: "d6fd5455-c909-4e5f-88d9-cf8fba87e3bf"). InnerVolumeSpecName "kube-api-access-dkz2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:31:43.477832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.477794    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:31:43.477832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.477828    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkz2q\" (UniqueName: \"kubernetes.io/projected/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-kube-api-access-dkz2q\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:31:43.477832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.477838    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:31:43.742679 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.742581    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" containerID="89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55" exitCode=0
Jul 07 22:31:43.742679 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.742642    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"
Jul 07 22:31:43.742679 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.742665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh" event={"ID":"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf","Type":"ContainerDied","Data":"89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55"}
Jul 07 22:31:43.742957 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.742720    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh" event={"ID":"d6fd5455-c909-4e5f-88d9-cf8fba87e3bf","Type":"ContainerDied","Data":"e02820056c53fb01951fa5a0c7369def0cb61d4ed8aa009e0580be34e8228ed3"}
Jul 07 22:31:43.742957 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.742743    2573 scope.go:117] "RemoveContainer" containerID="89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55"
Jul 07 22:31:43.751523 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.751492    2573 scope.go:117] "RemoveContainer" containerID="89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55"
Jul 07 22:31:43.751815 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:31:43.751787    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55\": container with ID starting with 89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55 not found: ID does not exist" containerID="89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55"
Jul 07 22:31:43.751923 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.751826    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55"} err="failed to get container status \"89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55\": rpc error: code = NotFound desc = could not find container \"89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55\": container with ID starting with 89b1a9b652d521c846d210494644e3a3d38bdc0b2cba1ff79266b13c8822cc55 not found: ID does not exist"
Jul 07 22:31:43.759174 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.759146    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"]
Jul 07 22:31:43.763519 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:43.763498    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ac5ac682-5444d5b74f-v6kqh"]
Jul 07 22:31:45.504590 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:45.504559    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" path="/var/lib/kubelet/pods/d6fd5455-c909-4e5f-88d9-cf8fba87e3bf/volumes"
Jul 07 22:31:48.750183 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:48.750149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:48.850618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:48.850589    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:49.007649 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:49.007568    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:49.226624 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:49.226594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:49.347766 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:49.347665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:49.447371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:49.447327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:49.547332 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:49.547297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:55.141838 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:55.141807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:55.243263 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:55.243225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:55.339424 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:55.339387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:31:55.488435 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:31:55.488350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:01.189430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:01.189354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:01.240298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:01.240265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:08.085363 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:08.085327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:08.395646 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:08.395570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:08.651124 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:08.651048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:11.233817 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.233770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:11.326146 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.326108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:11.407181 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.407150    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"]
Jul 07 22:32:11.407604 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.407587    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" containerName="maas-api"
Jul 07 22:32:11.407604 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.407603    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" containerName="maas-api"
Jul 07 22:32:11.407763 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.407705    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6fd5455-c909-4e5f-88d9-cf8fba87e3bf" containerName="maas-api"
Jul 07 22:32:11.411007 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.410986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.413370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.413345    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-28c37d17-serving-cert\""
Jul 07 22:32:11.421230 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.421185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"]
Jul 07 22:32:11.442140 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.442100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:11.544542 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.544502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8491ba99-6d55-48f4-91c5-573d40a3edb4-maas-api-tls\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.544749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.544644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zvzs\" (UniqueName: \"kubernetes.io/projected/8491ba99-6d55-48f4-91c5-573d40a3edb4-kube-api-access-9zvzs\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.544749 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.544701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8491ba99-6d55-48f4-91c5-573d40a3edb4-openshift-service-ca\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.645927 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.645897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zvzs\" (UniqueName: \"kubernetes.io/projected/8491ba99-6d55-48f4-91c5-573d40a3edb4-kube-api-access-9zvzs\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.646118 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.645938    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8491ba99-6d55-48f4-91c5-573d40a3edb4-openshift-service-ca\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.646118 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.645992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8491ba99-6d55-48f4-91c5-573d40a3edb4-maas-api-tls\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.646694 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.646671    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8491ba99-6d55-48f4-91c5-573d40a3edb4-openshift-service-ca\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.648561 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.648541    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8491ba99-6d55-48f4-91c5-573d40a3edb4-maas-api-tls\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.658854 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.658824    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zvzs\" (UniqueName: \"kubernetes.io/projected/8491ba99-6d55-48f4-91c5-573d40a3edb4-kube-api-access-9zvzs\") pod \"maas-api-e2e-mt-28c37d17-65b6795d87-bblkm\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") " pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.722773 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.722734    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:11.744098 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.744045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:11.863483 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.863443    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"]
Jul 07 22:32:11.866063 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:32:11.866034    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8491ba99_6d55_48f4_91c5_573d40a3edb4.slice/crio-c44359c63b9b2c83ce188694a45c82920a1087c6698f9aae23519bedd68f716f WatchSource:0}: Error finding container c44359c63b9b2c83ce188694a45c82920a1087c6698f9aae23519bedd68f716f: Status 404 returned error can't find the container with id c44359c63b9b2c83ce188694a45c82920a1087c6698f9aae23519bedd68f716f
Jul 07 22:32:11.894532 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.894505    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm" event={"ID":"8491ba99-6d55-48f4-91c5-573d40a3edb4","Type":"ContainerStarted","Data":"c44359c63b9b2c83ce188694a45c82920a1087c6698f9aae23519bedd68f716f"}
Jul 07 22:32:11.970078 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:11.970039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:12.069675 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:12.069595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:12.900463 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:12.900425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm" event={"ID":"8491ba99-6d55-48f4-91c5-573d40a3edb4","Type":"ContainerStarted","Data":"903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592"}
Jul 07 22:32:12.900837 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:12.900560    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:12.915617 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:12.915562    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm" podStartSLOduration=1.431290657 podStartE2EDuration="1.915542683s" totalImagesPullingTime="484.252026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:32:12.914827678 +0000 UTC m=+1713.924766856" watchObservedRunningTime="2026-07-07 22:32:12.915542683 +0000 UTC m=+1713.925481861"
Jul 07 22:32:15.736424 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:15.736383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:18.910483 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:18.910448    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:20.699416 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:20.699382    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:25.822466 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:25.822431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:25.923068 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:25.923025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:33.391391 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:33.391361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:33.543779 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:33.543741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:53.160961 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.160921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:53.458993 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.458892    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"]
Jul 07 22:32:53.459227 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.459157    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm" podUID="8491ba99-6d55-48f4-91c5-573d40a3edb4" containerName="maas-api" containerID="cri-o://903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592" gracePeriod=30
Jul 07 22:32:53.483307 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.483280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:32:53.716305 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.716246    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:53.836280 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.836247    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zvzs\" (UniqueName: \"kubernetes.io/projected/8491ba99-6d55-48f4-91c5-573d40a3edb4-kube-api-access-9zvzs\") pod \"8491ba99-6d55-48f4-91c5-573d40a3edb4\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") "
Jul 07 22:32:53.836464 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.836356    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8491ba99-6d55-48f4-91c5-573d40a3edb4-maas-api-tls\") pod \"8491ba99-6d55-48f4-91c5-573d40a3edb4\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") "
Jul 07 22:32:53.836464 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.836380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8491ba99-6d55-48f4-91c5-573d40a3edb4-openshift-service-ca\") pod \"8491ba99-6d55-48f4-91c5-573d40a3edb4\" (UID: \"8491ba99-6d55-48f4-91c5-573d40a3edb4\") "
Jul 07 22:32:53.836760 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.836732    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8491ba99-6d55-48f4-91c5-573d40a3edb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8491ba99-6d55-48f4-91c5-573d40a3edb4" (UID: "8491ba99-6d55-48f4-91c5-573d40a3edb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:32:53.838459 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.838434    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8491ba99-6d55-48f4-91c5-573d40a3edb4-kube-api-access-9zvzs" (OuterVolumeSpecName: "kube-api-access-9zvzs") pod "8491ba99-6d55-48f4-91c5-573d40a3edb4" (UID: "8491ba99-6d55-48f4-91c5-573d40a3edb4"). InnerVolumeSpecName "kube-api-access-9zvzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:32:53.838563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.838542    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8491ba99-6d55-48f4-91c5-573d40a3edb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8491ba99-6d55-48f4-91c5-573d40a3edb4" (UID: "8491ba99-6d55-48f4-91c5-573d40a3edb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:32:53.937265 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.937230    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8491ba99-6d55-48f4-91c5-573d40a3edb4-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:32:53.937265 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.937260    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8491ba99-6d55-48f4-91c5-573d40a3edb4-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:32:53.937477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:53.937274    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zvzs\" (UniqueName: \"kubernetes.io/projected/8491ba99-6d55-48f4-91c5-573d40a3edb4-kube-api-access-9zvzs\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:32:54.103183 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.103151    2573 generic.go:356] "Generic (PLEG): container finished" podID="8491ba99-6d55-48f4-91c5-573d40a3edb4" containerID="903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592" exitCode=0
Jul 07 22:32:54.103370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.103208    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"
Jul 07 22:32:54.103370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.103234    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm" event={"ID":"8491ba99-6d55-48f4-91c5-573d40a3edb4","Type":"ContainerDied","Data":"903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592"}
Jul 07 22:32:54.103370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.103293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm" event={"ID":"8491ba99-6d55-48f4-91c5-573d40a3edb4","Type":"ContainerDied","Data":"c44359c63b9b2c83ce188694a45c82920a1087c6698f9aae23519bedd68f716f"}
Jul 07 22:32:54.103370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.103324    2573 scope.go:117] "RemoveContainer" containerID="903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592"
Jul 07 22:32:54.114441 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.113646    2573 scope.go:117] "RemoveContainer" containerID="903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592"
Jul 07 22:32:54.115348 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:32:54.115325    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592\": container with ID starting with 903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592 not found: ID does not exist" containerID="903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592"
Jul 07 22:32:54.115463 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.115355    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592"} err="failed to get container status \"903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592\": rpc error: code = NotFound desc = could not find container \"903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592\": container with ID starting with 903cef6ce0b4a30c52611268e730eeb79b0224ac02c4449ac3600ce9ef5ad592 not found: ID does not exist"
Jul 07 22:32:54.123852 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.123830    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"]
Jul 07 22:32:54.127737 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:54.127717    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-28c37d17-65b6795d87-bblkm"]
Jul 07 22:32:55.503768 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:55.503732    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8491ba99-6d55-48f4-91c5-573d40a3edb4" path="/var/lib/kubelet/pods/8491ba99-6d55-48f4-91c5-573d40a3edb4/volumes"
Jul 07 22:32:59.216850 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:32:59.216818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:04.249505 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:04.249474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:39.501076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:39.501043    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:33:39.506725 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:39.506703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:33:40.394169 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:40.394124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:41.608712 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:41.608676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:46.816750 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:46.816704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:52.367887 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:52.367854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:52.420429 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:52.420387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:52.657783 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:52.657694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:52.880505 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:52.880475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:53.928481 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:53.928451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:54.026419 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:54.026387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:54.126723 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:54.126692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:54.827284 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:54.827244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:54.927012 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:54.926976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:55.028069 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:55.028034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:33:56.378359 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:33:56.378327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:02.091398 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:02.091363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:02.149691 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:02.149645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:02.761501 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:02.761470    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:08.415133 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:08.415098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:08.481393 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:08.481355    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:08.553856 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:08.553823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:08.649944 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:08.649915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:19.099066 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:19.099035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:19.436395 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:19.436314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:34.960074 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:34.960040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:35.061262 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:35.061226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:40.395493 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:40.395456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:45.934941 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:45.934907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:46.005631 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:46.005597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:46.272877 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:46.272849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:46.603719 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:46.603632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:46.709827 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:46.709788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:49.020023 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.019990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:49.119392 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.119361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:49.195483 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.195450    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"]
Jul 07 22:34:49.195968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.195945    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8491ba99-6d55-48f4-91c5-573d40a3edb4" containerName="maas-api"
Jul 07 22:34:49.196174 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.196128    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8491ba99-6d55-48f4-91c5-573d40a3edb4" containerName="maas-api"
Jul 07 22:34:49.196494 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.196473    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8491ba99-6d55-48f4-91c5-573d40a3edb4" containerName="maas-api"
Jul 07 22:34:49.199572 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.199556    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.201738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.201713    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-f8bdec-serving-cert\""
Jul 07 22:34:49.213358 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.213331    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"]
Jul 07 22:34:49.291148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.291044    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:49.377968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.377936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtndn\" (UniqueName: \"kubernetes.io/projected/a555614f-6f4c-478f-b4a0-43578ff4cd21-kube-api-access-wtndn\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.377968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.377971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a555614f-6f4c-478f-b4a0-43578ff4cd21-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.378186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.378036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.479075 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.479036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.479290 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.479112    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtndn\" (UniqueName: \"kubernetes.io/projected/a555614f-6f4c-478f-b4a0-43578ff4cd21-kube-api-access-wtndn\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.479290 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.479134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a555614f-6f4c-478f-b4a0-43578ff4cd21-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.479290 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:34:49.479185    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-f8bdec-serving-cert: secret "maas-api-e2e-inf-a-f8bdec-serving-cert" not found
Jul 07 22:34:49.479290 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:34:49.479267    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls podName:a555614f-6f4c-478f-b4a0-43578ff4cd21 nodeName:}" failed. No retries permitted until 2026-07-07 22:34:49.979250189 +0000 UTC m=+1870.989189348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls") pod "maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb" (UID: "a555614f-6f4c-478f-b4a0-43578ff4cd21") : secret "maas-api-e2e-inf-a-f8bdec-serving-cert" not found
Jul 07 22:34:49.479727 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.479710    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a555614f-6f4c-478f-b4a0-43578ff4cd21-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.488258 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.488233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtndn\" (UniqueName: \"kubernetes.io/projected/a555614f-6f4c-478f-b4a0-43578ff4cd21-kube-api-access-wtndn\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.603232 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.603106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:49.822037 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.821987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:49.931434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.931349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:49.983624 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.983583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:49.986150 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:49.986121    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls\") pod \"maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") " pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:50.110575 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:50.110544    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:50.254880 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:50.254850    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"]
Jul 07 22:34:50.258733 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:50.258711    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:34:50.670582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:50.670538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb" event={"ID":"a555614f-6f4c-478f-b4a0-43578ff4cd21","Type":"ContainerStarted","Data":"35dfca10432f8821bcabfb0f6810d369ba9e9abe768a77709dc1d0a0d30cc180"}
Jul 07 22:34:51.677577 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:51.677541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb" event={"ID":"a555614f-6f4c-478f-b4a0-43578ff4cd21","Type":"ContainerStarted","Data":"766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008"}
Jul 07 22:34:51.678104 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:51.677648    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:51.694725 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:51.694675    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb" podStartSLOduration=2.221472236 podStartE2EDuration="2.694658562s" totalImagesPullingTime="473.186326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:34:51.692843168 +0000 UTC m=+1872.702782345" watchObservedRunningTime="2026-07-07 22:34:51.694658562 +0000 UTC m=+1872.704597740"
Jul 07 22:34:53.507746 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:53.507715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:53.843534 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:53.843445    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:54.096414 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.096339    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"]
Jul 07 22:34:54.100469 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.100445    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.102883 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.102858    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-518a69-openshift-default-dockercfg-68pk5\""
Jul 07 22:34:54.112757 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.112735    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"]
Jul 07 22:34:54.126475 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.126451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:54.130887 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.130861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-podinfo\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131001 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.130908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxpl\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-kube-api-access-prxpl\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131001 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.130970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-socket\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131001 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.130992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-token\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131137 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.131051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-envoy\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131137 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.131069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-data\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131137 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.131090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istiod-ca-cert\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.131143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-credential-socket\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.131253 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.131163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-certs\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232234 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-podinfo\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxpl\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-kube-api-access-prxpl\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-socket\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232376    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-token\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232609 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-envoy\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232609 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-data\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232609 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istiod-ca-cert\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232609 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-credential-socket\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232609 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-certs\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232873 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232761    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-socket\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232873 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232842    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-data\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232897    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-credential-socket\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.232974 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.232957    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-certs\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.233506 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.233484    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istiod-ca-cert\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.234807 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.234783    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-envoy\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.234965 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.234946    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-podinfo\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.243086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.243062    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-token\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.243218 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.243134    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxpl\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-kube-api-access-prxpl\") pod \"e2e-inf-b-518a69-openshift-default-76864447bc-nxrms\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") " pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.281657 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.281615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:54.411935 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.411854    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:54.558498 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.558330    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"]
Jul 07 22:34:54.560761 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:34:54.560732    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7ad71e_73cf_41f6_ba52_0277ca347ef4.slice/crio-8eed2b6939c9007c305d4e226e032bc7738d8580c86eba8e4da22b42ece81c36 WatchSource:0}: Error finding container 8eed2b6939c9007c305d4e226e032bc7738d8580c86eba8e4da22b42ece81c36: Status 404 returned error can't find the container with id 8eed2b6939c9007c305d4e226e032bc7738d8580c86eba8e4da22b42ece81c36
Jul 07 22:34:54.562987 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.562954    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:34:54.563081 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.563050    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:34:54.563150 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.563098    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:34:54.696831 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.696735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" event={"ID":"7d7ad71e-73cf-41f6-ba52-0277ca347ef4","Type":"ContainerStarted","Data":"ccd56cb0a1347dead4d21cc4d273f4e27ee87c30e5db46b37818184f248ffcc2"}
Jul 07 22:34:54.696831 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.696786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" event={"ID":"7d7ad71e-73cf-41f6-ba52-0277ca347ef4","Type":"ContainerStarted","Data":"8eed2b6939c9007c305d4e226e032bc7738d8580c86eba8e4da22b42ece81c36"}
Jul 07 22:34:54.715178 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:54.715117    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" podStartSLOduration=0.715100144 podStartE2EDuration="715.100144ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:34:54.713954022 +0000 UTC m=+1875.723893199" watchObservedRunningTime="2026-07-07 22:34:54.715100144 +0000 UTC m=+1875.725039375"
Jul 07 22:34:55.412322 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:55.412283    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:55.417765 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:55.417738    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:55.702041 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:55.701939    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:55.703086 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:55.703066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:34:56.619468 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.619441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:56.673100 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.673063    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"]
Jul 07 22:34:56.677745 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.677719    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.679908 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.679887    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-518a69-serving-cert\""
Jul 07 22:34:56.687454 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.687432    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"]
Jul 07 22:34:56.706190 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.706157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:56.754158 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.754123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0ab7e20-189e-4d42-af2d-adcb5a67c653-maas-api-tls\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.754348 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.754175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lww82\" (UniqueName: \"kubernetes.io/projected/c0ab7e20-189e-4d42-af2d-adcb5a67c653-kube-api-access-lww82\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.754519 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.754491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ab7e20-189e-4d42-af2d-adcb5a67c653-openshift-service-ca\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.834873 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.834841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:56.855632 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.855604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0ab7e20-189e-4d42-af2d-adcb5a67c653-maas-api-tls\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.855817 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.855639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lww82\" (UniqueName: \"kubernetes.io/projected/c0ab7e20-189e-4d42-af2d-adcb5a67c653-kube-api-access-lww82\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.855817 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.855748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ab7e20-189e-4d42-af2d-adcb5a67c653-openshift-service-ca\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.856596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.856568    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ab7e20-189e-4d42-af2d-adcb5a67c653-openshift-service-ca\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.858685 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.858650    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0ab7e20-189e-4d42-af2d-adcb5a67c653-maas-api-tls\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.871081 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.871028    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lww82\" (UniqueName: \"kubernetes.io/projected/c0ab7e20-189e-4d42-af2d-adcb5a67c653-kube-api-access-lww82\") pod \"maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") " pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:56.969374 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.969327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:56.991567 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:56.991537    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:57.134553 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.134519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"]
Jul 07 22:34:57.135834 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:34:57.135806    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ab7e20_189e_4d42_af2d_adcb5a67c653.slice/crio-389bc89ff0ead69a0340dc55f48974aded9294a364d333b4f73e5ebaad5cb4db WatchSource:0}: Error finding container 389bc89ff0ead69a0340dc55f48974aded9294a364d333b4f73e5ebaad5cb4db: Status 404 returned error can't find the container with id 389bc89ff0ead69a0340dc55f48974aded9294a364d333b4f73e5ebaad5cb4db
Jul 07 22:34:57.282474 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.282436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:57.383341 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.383257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:34:57.689737 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.689712    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:34:57.713796 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.713769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6" event={"ID":"c0ab7e20-189e-4d42-af2d-adcb5a67c653","Type":"ContainerStarted","Data":"ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06"}
Jul 07 22:34:57.714166 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.713826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6" event={"ID":"c0ab7e20-189e-4d42-af2d-adcb5a67c653","Type":"ContainerStarted","Data":"389bc89ff0ead69a0340dc55f48974aded9294a364d333b4f73e5ebaad5cb4db"}
Jul 07 22:34:57.714166 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.713858    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:34:57.730139 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:34:57.730065    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6" podStartSLOduration=1.221245498 podStartE2EDuration="1.730049873s" totalImagesPullingTime="508.804375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:34:57.729076854 +0000 UTC m=+1878.739016033" watchObservedRunningTime="2026-07-07 22:34:57.730049873 +0000 UTC m=+1878.739989072"
Jul 07 22:35:01.107005 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:01.106916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:35:03.726488 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:03.726461    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:35:10.610672 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.610636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:35:10.703421 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.703393    2573 patch_prober.go:28] interesting pod/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 22:35:10.703584 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.703456    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 22:35:10.712101 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.712068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:35:10.787868 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.787837    2573 generic.go:356] "Generic (PLEG): container finished" podID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerID="ccd56cb0a1347dead4d21cc4d273f4e27ee87c30e5db46b37818184f248ffcc2" exitCode=0
Jul 07 22:35:10.788060 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.787905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" event={"ID":"7d7ad71e-73cf-41f6-ba52-0277ca347ef4","Type":"ContainerDied","Data":"ccd56cb0a1347dead4d21cc4d273f4e27ee87c30e5db46b37818184f248ffcc2"}
Jul 07 22:35:10.788368 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.788353    2573 scope.go:117] "RemoveContainer" containerID="ccd56cb0a1347dead4d21cc4d273f4e27ee87c30e5db46b37818184f248ffcc2"
Jul 07 22:35:10.789403 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.789370    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:35:10.789557 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.789467    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:35:10.789557 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:10.789540    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:35:11.794380 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:11.794345    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" event={"ID":"7d7ad71e-73cf-41f6-ba52-0277ca347ef4","Type":"ContainerStarted","Data":"3839387beb0ed70a1cb6b37f187381577199ebe727be3165279b3fd788d70af5"}
Jul 07 22:35:12.412583 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:12.412546    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:35:12.412778 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:12.412760    2573 patch_prober.go:28] interesting pod/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 22:35:12.412825 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:12.412800    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 22:35:13.412850 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:13.412812    2573 patch_prober.go:28] interesting pod/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 22:35:13.413259 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:13.412871    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 22:35:14.412966 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:14.412925    2573 patch_prober.go:28] interesting pod/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 22:35:14.413384 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:14.412983    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 22:35:15.412979 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:15.412937    2573 patch_prober.go:28] interesting pod/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 22:35:15.413412 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:15.412996    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 22:35:16.415984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:16.415947    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:35:16.416373 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:16.416303    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:35:16.417088 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:16.417070    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:35:17.954913 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:17.954883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:35:18.054043 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:18.053994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:35:23.235347 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:23.235311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:35:32.193514 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:32.193424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:35:32.304457 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:35:32.304425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:00.137928 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:00.137891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:20.006407 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:20.006375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:21.030846 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:21.030811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:21.191285 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:21.191248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:21.595314 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:21.595282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:21.696122 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:21.696090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:21.821997 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:21.821965    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"]
Jul 07 22:36:21.822270 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:21.822245    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb" podUID="a555614f-6f4c-478f-b4a0-43578ff4cd21" containerName="maas-api" containerID="cri-o://766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008" gracePeriod=30
Jul 07 22:36:21.848440 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:21.848379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:36:22.075323 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.075297    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:36:22.159522 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.159432    2573 generic.go:356] "Generic (PLEG): container finished" podID="a555614f-6f4c-478f-b4a0-43578ff4cd21" containerID="766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008" exitCode=0
Jul 07 22:36:22.159522 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.159482    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"
Jul 07 22:36:22.159522 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.159506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb" event={"ID":"a555614f-6f4c-478f-b4a0-43578ff4cd21","Type":"ContainerDied","Data":"766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008"}
Jul 07 22:36:22.159810 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.159562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb" event={"ID":"a555614f-6f4c-478f-b4a0-43578ff4cd21","Type":"ContainerDied","Data":"35dfca10432f8821bcabfb0f6810d369ba9e9abe768a77709dc1d0a0d30cc180"}
Jul 07 22:36:22.159810 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.159591    2573 scope.go:117] "RemoveContainer" containerID="766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008"
Jul 07 22:36:22.168738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.168718    2573 scope.go:117] "RemoveContainer" containerID="766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008"
Jul 07 22:36:22.169003 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:36:22.168982    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008\": container with ID starting with 766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008 not found: ID does not exist" containerID="766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008"
Jul 07 22:36:22.169055 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.169014    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008"} err="failed to get container status \"766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008\": rpc error: code = NotFound desc = could not find container \"766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008\": container with ID starting with 766dc8f636fae86e637c1b611258e768814f7fd7b6f91022dd4421875cdc3008 not found: ID does not exist"
Jul 07 22:36:22.184400 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.184375    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a555614f-6f4c-478f-b4a0-43578ff4cd21-openshift-service-ca\") pod \"a555614f-6f4c-478f-b4a0-43578ff4cd21\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") "
Jul 07 22:36:22.184515 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.184417    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtndn\" (UniqueName: \"kubernetes.io/projected/a555614f-6f4c-478f-b4a0-43578ff4cd21-kube-api-access-wtndn\") pod \"a555614f-6f4c-478f-b4a0-43578ff4cd21\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") "
Jul 07 22:36:22.184515 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.184484    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls\") pod \"a555614f-6f4c-478f-b4a0-43578ff4cd21\" (UID: \"a555614f-6f4c-478f-b4a0-43578ff4cd21\") "
Jul 07 22:36:22.184779 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.184751    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a555614f-6f4c-478f-b4a0-43578ff4cd21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a555614f-6f4c-478f-b4a0-43578ff4cd21" (UID: "a555614f-6f4c-478f-b4a0-43578ff4cd21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:36:22.186618 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.186590    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a555614f-6f4c-478f-b4a0-43578ff4cd21" (UID: "a555614f-6f4c-478f-b4a0-43578ff4cd21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:36:22.186694 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.186645    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a555614f-6f4c-478f-b4a0-43578ff4cd21-kube-api-access-wtndn" (OuterVolumeSpecName: "kube-api-access-wtndn") pod "a555614f-6f4c-478f-b4a0-43578ff4cd21" (UID: "a555614f-6f4c-478f-b4a0-43578ff4cd21"). InnerVolumeSpecName "kube-api-access-wtndn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:36:22.285896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.285861    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtndn\" (UniqueName: \"kubernetes.io/projected/a555614f-6f4c-478f-b4a0-43578ff4cd21-kube-api-access-wtndn\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:36:22.285896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.285892    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a555614f-6f4c-478f-b4a0-43578ff4cd21-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:36:22.285896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.285901    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a555614f-6f4c-478f-b4a0-43578ff4cd21-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:36:22.481833 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.481791    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"]
Jul 07 22:36:22.484848 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:22.484817    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f8bdec-75d89d99f8-jtdcb"]
Jul 07 22:36:23.503920 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:23.503877    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a555614f-6f4c-478f-b4a0-43578ff4cd21" path="/var/lib/kubelet/pods/a555614f-6f4c-478f-b4a0-43578ff4cd21/volumes"
Jul 07 22:36:26.674148 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:36:26.674111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:03.236944 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:03.236904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:03.495467 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:03.495381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:03.721812 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:03.721765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:03.877914 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:03.877878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:04.287190 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.287161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:04.476444 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.476409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:04.573857 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.573777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:04.687829 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.687783    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"]
Jul 07 22:37:04.688063 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.688038    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6" podUID="c0ab7e20-189e-4d42-af2d-adcb5a67c653" containerName="maas-api" containerID="cri-o://ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06" gracePeriod=30
Jul 07 22:37:04.718100 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.718078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:04.943730 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.943703    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:37:04.994097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.994064    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lww82\" (UniqueName: \"kubernetes.io/projected/c0ab7e20-189e-4d42-af2d-adcb5a67c653-kube-api-access-lww82\") pod \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") "
Jul 07 22:37:04.994097 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.994108    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ab7e20-189e-4d42-af2d-adcb5a67c653-openshift-service-ca\") pod \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") "
Jul 07 22:37:04.994374 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.994179    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0ab7e20-189e-4d42-af2d-adcb5a67c653-maas-api-tls\") pod \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\" (UID: \"c0ab7e20-189e-4d42-af2d-adcb5a67c653\") "
Jul 07 22:37:04.994622 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.994590    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ab7e20-189e-4d42-af2d-adcb5a67c653-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0ab7e20-189e-4d42-af2d-adcb5a67c653" (UID: "c0ab7e20-189e-4d42-af2d-adcb5a67c653"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:37:04.996558 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.996523    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ab7e20-189e-4d42-af2d-adcb5a67c653-kube-api-access-lww82" (OuterVolumeSpecName: "kube-api-access-lww82") pod "c0ab7e20-189e-4d42-af2d-adcb5a67c653" (UID: "c0ab7e20-189e-4d42-af2d-adcb5a67c653"). InnerVolumeSpecName "kube-api-access-lww82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:37:04.996908 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:04.996884    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ab7e20-189e-4d42-af2d-adcb5a67c653-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0ab7e20-189e-4d42-af2d-adcb5a67c653" (UID: "c0ab7e20-189e-4d42-af2d-adcb5a67c653"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:37:05.095617 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.095579    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lww82\" (UniqueName: \"kubernetes.io/projected/c0ab7e20-189e-4d42-af2d-adcb5a67c653-kube-api-access-lww82\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:05.095617 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.095611    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ab7e20-189e-4d42-af2d-adcb5a67c653-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:05.095617 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.095621    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0ab7e20-189e-4d42-af2d-adcb5a67c653-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:05.370853 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.370819    2573 generic.go:356] "Generic (PLEG): container finished" podID="c0ab7e20-189e-4d42-af2d-adcb5a67c653" containerID="ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06" exitCode=0
Jul 07 22:37:05.371299 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.370864    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"
Jul 07 22:37:05.371299 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.370874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6" event={"ID":"c0ab7e20-189e-4d42-af2d-adcb5a67c653","Type":"ContainerDied","Data":"ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06"}
Jul 07 22:37:05.371299 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.370916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6" event={"ID":"c0ab7e20-189e-4d42-af2d-adcb5a67c653","Type":"ContainerDied","Data":"389bc89ff0ead69a0340dc55f48974aded9294a364d333b4f73e5ebaad5cb4db"}
Jul 07 22:37:05.371299 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.370937    2573 scope.go:117] "RemoveContainer" containerID="ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06"
Jul 07 22:37:05.380376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.380358    2573 scope.go:117] "RemoveContainer" containerID="ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06"
Jul 07 22:37:05.380643 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:37:05.380620    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06\": container with ID starting with ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06 not found: ID does not exist" containerID="ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06"
Jul 07 22:37:05.380688 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.380653    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06"} err="failed to get container status \"ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06\": rpc error: code = NotFound desc = could not find container \"ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06\": container with ID starting with ae7f698f1857205991b309949852d7fe8f6f650e3f0396ddd45e434159e87e06 not found: ID does not exist"
Jul 07 22:37:05.391845 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.391821    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"]
Jul 07 22:37:05.395479 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.395455    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-518a69-65b7547bf9-cdvp6"]
Jul 07 22:37:05.504255 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:05.504222    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ab7e20-189e-4d42-af2d-adcb5a67c653" path="/var/lib/kubelet/pods/c0ab7e20-189e-4d42-af2d-adcb5a67c653/volumes"
Jul 07 22:37:09.970227 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:09.970151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:10.037207 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:10.037161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:10.280363 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:10.280328    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"]
Jul 07 22:37:10.280607 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:10.280581    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy" containerID="cri-o://3839387beb0ed70a1cb6b37f187381577199ebe727be3165279b3fd788d70af5" gracePeriod=30
Jul 07 22:37:10.304933 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:10.304906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:10.482728 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:10.482692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:10.832232 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:10.832168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:11.141575 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:11.141475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:11.611532 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:11.611501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:13.724252 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.724220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:13.779462 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.779428    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"]
Jul 07 22:37:13.780033 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.780017    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a555614f-6f4c-478f-b4a0-43578ff4cd21" containerName="maas-api"
Jul 07 22:37:13.780076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.780038    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a555614f-6f4c-478f-b4a0-43578ff4cd21" containerName="maas-api"
Jul 07 22:37:13.780076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.780068    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ab7e20-189e-4d42-af2d-adcb5a67c653" containerName="maas-api"
Jul 07 22:37:13.780144 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.780077    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ab7e20-189e-4d42-af2d-adcb5a67c653" containerName="maas-api"
Jul 07 22:37:13.780175 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.780160    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a555614f-6f4c-478f-b4a0-43578ff4cd21" containerName="maas-api"
Jul 07 22:37:13.780241 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.780176    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ab7e20-189e-4d42-af2d-adcb5a67c653" containerName="maas-api"
Jul 07 22:37:13.783881 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.783860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.786279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.786261    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-75ee45-serving-cert\""
Jul 07 22:37:13.790175 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.790152    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"]
Jul 07 22:37:13.804599 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.804574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:13.874936 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.874859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:13.879105 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.879073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-openshift-service-ca\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.879292 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.879125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d4f8\" (UniqueName: \"kubernetes.io/projected/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-kube-api-access-5d4f8\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.879292 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.879262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.980751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.980638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-openshift-service-ca\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.980751 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.980700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d4f8\" (UniqueName: \"kubernetes.io/projected/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-kube-api-access-5d4f8\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.981016 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.980762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.981016 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:37:13.980920    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-75ee45-serving-cert: secret "maas-api-e2e-api-a-75ee45-serving-cert" not found
Jul 07 22:37:13.981016 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:37:13.980980    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls podName:4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97 nodeName:}" failed. No retries permitted until 2026-07-07 22:37:14.480964738 +0000 UTC m=+2015.490903894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls") pod "maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv" (UID: "4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97") : secret "maas-api-e2e-api-a-75ee45-serving-cert" not found
Jul 07 22:37:13.981409 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.981380    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-openshift-service-ca\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:13.989826 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:13.989794    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d4f8\" (UniqueName: \"kubernetes.io/projected/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-kube-api-access-5d4f8\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:14.194786 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:14.194750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:14.350997 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:14.350968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:14.453839 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:14.453810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:14.484828 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:14.484794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:14.487325 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:14.487306    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls\") pod \"maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") " pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:14.695893 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:14.695806    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:14.844885 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:14.844337    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"]
Jul 07 22:37:14.845432 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:37:14.845405    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e74cb0c_d5a8_496e_ae8a_cd4f60b39a97.slice/crio-7c613d372c4c6f6f929fc6e2db00c2c607cebb5fde5bce371cdd7a59bd6b5a5f WatchSource:0}: Error finding container 7c613d372c4c6f6f929fc6e2db00c2c607cebb5fde5bce371cdd7a59bd6b5a5f: Status 404 returned error can't find the container with id 7c613d372c4c6f6f929fc6e2db00c2c607cebb5fde5bce371cdd7a59bd6b5a5f
Jul 07 22:37:15.422759 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.422728    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv" event={"ID":"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97","Type":"ContainerStarted","Data":"7c613d372c4c6f6f929fc6e2db00c2c607cebb5fde5bce371cdd7a59bd6b5a5f"}
Jul 07 22:37:15.424711 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.424685    2573 generic.go:356] "Generic (PLEG): container finished" podID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerID="3839387beb0ed70a1cb6b37f187381577199ebe727be3165279b3fd788d70af5" exitCode=0
Jul 07 22:37:15.424830 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.424753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" event={"ID":"7d7ad71e-73cf-41f6-ba52-0277ca347ef4","Type":"ContainerDied","Data":"3839387beb0ed70a1cb6b37f187381577199ebe727be3165279b3fd788d70af5"}
Jul 07 22:37:15.424830 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.424808    2573 scope.go:117] "RemoveContainer" containerID="ccd56cb0a1347dead4d21cc4d273f4e27ee87c30e5db46b37818184f248ffcc2"
Jul 07 22:37:15.539513 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.539490    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:37:15.696984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.696890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istiod-ca-cert\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.696984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.696950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-envoy\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.696984 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.696978    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-data\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.697291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697009    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-token\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.697291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prxpl\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-kube-api-access-prxpl\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.697291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697119    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-socket\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.697291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697162    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-podinfo\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.697291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697242    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-certs\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.697563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-credential-socket\") pod \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\" (UID: \"7d7ad71e-73cf-41f6-ba52-0277ca347ef4\") "
Jul 07 22:37:15.697563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697357    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:37:15.697667 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697592    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:15.697724 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697676    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istiod-ca-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.697724 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697698    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-certs\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.697841 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697729    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:15.697903 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.697882    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:15.698063 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.698020    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:15.699426 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.699398    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:15.699554 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.699529    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:37:15.699858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.699825    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:37:15.700033 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.700006    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-kube-api-access-prxpl" (OuterVolumeSpecName: "kube-api-access-prxpl") pod "7d7ad71e-73cf-41f6-ba52-0277ca347ef4" (UID: "7d7ad71e-73cf-41f6-ba52-0277ca347ef4"). InnerVolumeSpecName "kube-api-access-prxpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:37:15.799076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.799045    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-credential-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.799076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.799072    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-envoy\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.799076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.799080    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-data\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.799076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.799088    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-token\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.799381 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.799095    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prxpl\" (UniqueName: \"kubernetes.io/projected/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-kube-api-access-prxpl\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.799381 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.799104    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-workload-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:15.799381 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:15.799112    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ad71e-73cf-41f6-ba52-0277ca347ef4-istio-podinfo\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:16.432439 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.432399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv" event={"ID":"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97","Type":"ContainerStarted","Data":"3a6fd4c63ad7974b204f947ae8cab97d13841908ffdf11441d838fccfa16da3a"}
Jul 07 22:37:16.432887 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.432466    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:16.433704 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.433686    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"
Jul 07 22:37:16.433704 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.433689    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms" event={"ID":"7d7ad71e-73cf-41f6-ba52-0277ca347ef4","Type":"ContainerDied","Data":"8eed2b6939c9007c305d4e226e032bc7738d8580c86eba8e4da22b42ece81c36"}
Jul 07 22:37:16.433857 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.433731    2573 scope.go:117] "RemoveContainer" containerID="3839387beb0ed70a1cb6b37f187381577199ebe727be3165279b3fd788d70af5"
Jul 07 22:37:16.448212 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.448156    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv" podStartSLOduration=2.921852089 podStartE2EDuration="3.448141772s" totalImagesPullingTime="526.289683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:37:16.447738402 +0000 UTC m=+2017.457677581" watchObservedRunningTime="2026-07-07 22:37:16.448141772 +0000 UTC m=+2017.458080949"
Jul 07 22:37:16.460596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.460569    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"]
Jul 07 22:37:16.462587 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:16.462564    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-518a69-openshift-default-76864447bc-nxrms"]
Jul 07 22:37:17.504903 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:17.504868    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" path="/var/lib/kubelet/pods/7d7ad71e-73cf-41f6-ba52-0277ca347ef4/volumes"
Jul 07 22:37:18.208867 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.208832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:18.672254 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.672215    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:18.937042 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.936964    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"]
Jul 07 22:37:18.937382 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.937369    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy"
Jul 07 22:37:18.937448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.937384    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy"
Jul 07 22:37:18.937448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.937405    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy"
Jul 07 22:37:18.937448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.937411    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy"
Jul 07 22:37:18.937563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.937485    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy"
Jul 07 22:37:18.941937 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.941914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:18.944858 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.944833    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f6520f-openshift-default-dockercfg-pbj8q\""
Jul 07 22:37:18.952058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.952034    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"]
Jul 07 22:37:18.972673 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:18.972641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:19.031489 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj8xz\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-kube-api-access-fj8xz\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.031489 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-token\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.031744 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031530    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-data\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.031744 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-podinfo\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.031744 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-certs\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.031744 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-credential-socket\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.031744 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-socket\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.032257 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-envoy\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.032257 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.031817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istiod-ca-cert\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133109 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj8xz\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-kube-api-access-fj8xz\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133109 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-token\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-data\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-podinfo\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-certs\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-credential-socket\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-socket\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133748 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-envoy\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133748 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istiod-ca-cert\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133748 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-data\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133905 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133745    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-credential-socket\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133905 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133761    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-certs\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.133905 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.133842    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-socket\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.134326 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.134301    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istiod-ca-cert\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.135727 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.135707    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-envoy\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.135871 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.135853    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-podinfo\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.140665 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.140639    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-token\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.141384 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.141363    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj8xz\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-kube-api-access-fj8xz\") pod \"e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") " pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.144155 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.144128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:19.254213 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.254163    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:19.428443 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.428417    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"]
Jul 07 22:37:19.430026 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:37:19.429996    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa8e534_7d92_4c1f_85cb_c8c9292a0c09.slice/crio-30e0ad63aa4fd9b28829ad39c94fb242073361c572d6bb739216a1b559b58bd0 WatchSource:0}: Error finding container 30e0ad63aa4fd9b28829ad39c94fb242073361c572d6bb739216a1b559b58bd0: Status 404 returned error can't find the container with id 30e0ad63aa4fd9b28829ad39c94fb242073361c572d6bb739216a1b559b58bd0
Jul 07 22:37:19.432272 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.432240    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:37:19.432383 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.432307    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:37:19.432383 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.432339    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:37:19.460034 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:19.460005    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" event={"ID":"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09","Type":"ContainerStarted","Data":"30e0ad63aa4fd9b28829ad39c94fb242073361c572d6bb739216a1b559b58bd0"}
Jul 07 22:37:20.466825 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:20.466790    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" event={"ID":"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09","Type":"ContainerStarted","Data":"7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6"}
Jul 07 22:37:20.487227 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:20.487163    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" podStartSLOduration=2.487142197 podStartE2EDuration="2.487142197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:37:20.485521715 +0000 UTC m=+2021.495460894" watchObservedRunningTime="2026-07-07 22:37:20.487142197 +0000 UTC m=+2021.497081377"
Jul 07 22:37:21.254532 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:21.254503    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:21.259704 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:21.259679    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:21.471857 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:21.471822    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:21.472760 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:21.472742    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:22.349100 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.349059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:22.449522 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.449488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:22.453365 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.453339    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:22.535406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.535369    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"]
Jul 07 22:37:22.536119 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.536095    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7ad71e-73cf-41f6-ba52-0277ca347ef4" containerName="istio-proxy"
Jul 07 22:37:22.539794 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.539771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.542229 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.542185    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-f6520f-serving-cert\""
Jul 07 22:37:22.547437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.547413    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"]
Jul 07 22:37:22.570849 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.570818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:22.666913 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.666813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18590473-cbe7-420b-a70f-8417fe1da07a-openshift-service-ca\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.666913 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.666866    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18590473-cbe7-420b-a70f-8417fe1da07a-maas-api-tls\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.667150 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.667045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npkkf\" (UniqueName: \"kubernetes.io/projected/18590473-cbe7-420b-a70f-8417fe1da07a-kube-api-access-npkkf\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.670371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.670345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:22.768012 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.767973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npkkf\" (UniqueName: \"kubernetes.io/projected/18590473-cbe7-420b-a70f-8417fe1da07a-kube-api-access-npkkf\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.768189 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.768063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18590473-cbe7-420b-a70f-8417fe1da07a-openshift-service-ca\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.768189 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.768092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18590473-cbe7-420b-a70f-8417fe1da07a-maas-api-tls\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.768772 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.768748    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18590473-cbe7-420b-a70f-8417fe1da07a-openshift-service-ca\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.770610 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.770581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18590473-cbe7-420b-a70f-8417fe1da07a-maas-api-tls\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.775982 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.775959    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npkkf\" (UniqueName: \"kubernetes.io/projected/18590473-cbe7-420b-a70f-8417fe1da07a-kube-api-access-npkkf\") pod \"maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") " pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.853428 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.853378    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:22.995094 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:22.995058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:23.003839 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:23.003811    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"]
Jul 07 22:37:23.005295 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:37:23.005265    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18590473_cbe7_420b_a70f_8417fe1da07a.slice/crio-593eac9750e6e7c50b279c6f1770fd9e00d5a5e3839e8fe1b42000557ffd585e WatchSource:0}: Error finding container 593eac9750e6e7c50b279c6f1770fd9e00d5a5e3839e8fe1b42000557ffd585e: Status 404 returned error can't find the container with id 593eac9750e6e7c50b279c6f1770fd9e00d5a5e3839e8fe1b42000557ffd585e
Jul 07 22:37:23.099808 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:23.099770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:23.483582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:23.483548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb" event={"ID":"18590473-cbe7-420b-a70f-8417fe1da07a","Type":"ContainerStarted","Data":"fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396"}
Jul 07 22:37:23.483742 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:23.483600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb" event={"ID":"18590473-cbe7-420b-a70f-8417fe1da07a","Type":"ContainerStarted","Data":"593eac9750e6e7c50b279c6f1770fd9e00d5a5e3839e8fe1b42000557ffd585e"}
Jul 07 22:37:23.483818 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:23.483772    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:23.508733 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:23.508684    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb" podStartSLOduration=1.22171749 podStartE2EDuration="1.508667817s" totalImagesPullingTime="286.950327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:37:23.505602098 +0000 UTC m=+2024.515541277" watchObservedRunningTime="2026-07-07 22:37:23.508667817 +0000 UTC m=+2024.518606994"
Jul 07 22:37:26.495563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:26.495528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:26.594247 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:26.594192    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:26.844469 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:26.844435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:29.494930 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:29.494895    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:34.844452 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:34.844413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:35.178516 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.178420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:35.277582 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.277537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:35.391030 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.390994    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"]
Jul 07 22:37:35.391662 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.391622    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv" podUID="4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" containerName="maas-api" containerID="cri-o://3a6fd4c63ad7974b204f947ae8cab97d13841908ffdf11441d838fccfa16da3a" gracePeriod=30
Jul 07 22:37:35.423708 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.423670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:35.544502 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.544463    2573 generic.go:356] "Generic (PLEG): container finished" podID="4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" containerID="3a6fd4c63ad7974b204f947ae8cab97d13841908ffdf11441d838fccfa16da3a" exitCode=0
Jul 07 22:37:35.544668 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.544510    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv" event={"ID":"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97","Type":"ContainerDied","Data":"3a6fd4c63ad7974b204f947ae8cab97d13841908ffdf11441d838fccfa16da3a"}
Jul 07 22:37:35.670500 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.670471    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:35.702684 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.702655    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-openshift-service-ca\") pod \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") "
Jul 07 22:37:35.702843 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.702703    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls\") pod \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") "
Jul 07 22:37:35.702843 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.702745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d4f8\" (UniqueName: \"kubernetes.io/projected/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-kube-api-access-5d4f8\") pod \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\" (UID: \"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97\") "
Jul 07 22:37:35.703074 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.703046    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" (UID: "4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:37:35.705114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.705080    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" (UID: "4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:37:35.705114 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.705096    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-kube-api-access-5d4f8" (OuterVolumeSpecName: "kube-api-access-5d4f8") pod "4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" (UID: "4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97"). InnerVolumeSpecName "kube-api-access-5d4f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:37:35.803715 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.803627    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:35.803715 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.803660    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:35.803715 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:35.803669    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d4f8\" (UniqueName: \"kubernetes.io/projected/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97-kube-api-access-5d4f8\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:36.552298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:36.552262    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"
Jul 07 22:37:36.552298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:36.552275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv" event={"ID":"4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97","Type":"ContainerDied","Data":"7c613d372c4c6f6f929fc6e2db00c2c607cebb5fde5bce371cdd7a59bd6b5a5f"}
Jul 07 22:37:36.552955 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:36.552338    2573 scope.go:117] "RemoveContainer" containerID="3a6fd4c63ad7974b204f947ae8cab97d13841908ffdf11441d838fccfa16da3a"
Jul 07 22:37:36.576173 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:36.576145    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"]
Jul 07 22:37:36.579510 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:36.579487    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-75ee45-7cbddc5598-r9rpv"]
Jul 07 22:37:37.505712 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:37.505677    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" path="/var/lib/kubelet/pods/4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97/volumes"
Jul 07 22:37:37.513378 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:37.513342    2573 patch_prober.go:28] interesting pod/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 22:37:37.513506 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:37.513431    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 22:37:38.565490 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:38.565457    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerID="7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6" exitCode=0
Jul 07 22:37:38.565912 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:38.565531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" event={"ID":"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09","Type":"ContainerDied","Data":"7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6"}
Jul 07 22:37:38.566004 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:38.565988    2573 scope.go:117] "RemoveContainer" containerID="7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6"
Jul 07 22:37:38.567119 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:38.567093    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:37:38.567190 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:38.567163    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:37:38.567259 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:38.567192    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 22:37:39.591524 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:39.591489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" event={"ID":"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09","Type":"ContainerStarted","Data":"1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834"}
Jul 07 22:37:40.255450 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:40.255406    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:40.255956 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:40.255919    2573 patch_prober.go:28] interesting pod/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 22:37:40.256244 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:40.256157    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 22:37:40.862394 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:40.862337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:40.919910 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:40.919879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:41.120310 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:41.120180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:41.255854 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:41.255432    2573 patch_prober.go:28] interesting pod/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 22:37:41.255854 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:41.255493    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 22:37:41.330449 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:41.330419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:41.477950 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:41.477852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:41.871436 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:41.871383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:42.037634 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.037585    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:42.143922 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.143823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:42.255455 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.254995    2573 patch_prober.go:28] interesting pod/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 22:37:42.255455 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.255057    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 22:37:42.271685 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.271648    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"]
Jul 07 22:37:42.272113 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.272079    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb" podUID="18590473-cbe7-420b-a70f-8417fe1da07a" containerName="maas-api" containerID="cri-o://fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396" gracePeriod=30
Jul 07 22:37:42.296966 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.296914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:42.567936 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.567635    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:42.608477 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.608447    2573 generic.go:356] "Generic (PLEG): container finished" podID="18590473-cbe7-420b-a70f-8417fe1da07a" containerID="fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396" exitCode=0
Jul 07 22:37:42.608647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.608488    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"
Jul 07 22:37:42.608647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.608511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb" event={"ID":"18590473-cbe7-420b-a70f-8417fe1da07a","Type":"ContainerDied","Data":"fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396"}
Jul 07 22:37:42.608647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.608554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb" event={"ID":"18590473-cbe7-420b-a70f-8417fe1da07a","Type":"ContainerDied","Data":"593eac9750e6e7c50b279c6f1770fd9e00d5a5e3839e8fe1b42000557ffd585e"}
Jul 07 22:37:42.608647 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.608581    2573 scope.go:117] "RemoveContainer" containerID="fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396"
Jul 07 22:37:42.618307 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.618289    2573 scope.go:117] "RemoveContainer" containerID="fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396"
Jul 07 22:37:42.618573 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:37:42.618549    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396\": container with ID starting with fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396 not found: ID does not exist" containerID="fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396"
Jul 07 22:37:42.618639 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.618586    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396"} err="failed to get container status \"fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396\": rpc error: code = NotFound desc = could not find container \"fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396\": container with ID starting with fcf0728d529b80500f226a5f9799c639739106649b270ca07b1d13058a676396 not found: ID does not exist"
Jul 07 22:37:42.680780 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.680670    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18590473-cbe7-420b-a70f-8417fe1da07a-maas-api-tls\") pod \"18590473-cbe7-420b-a70f-8417fe1da07a\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") "
Jul 07 22:37:42.680780 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.680770    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npkkf\" (UniqueName: \"kubernetes.io/projected/18590473-cbe7-420b-a70f-8417fe1da07a-kube-api-access-npkkf\") pod \"18590473-cbe7-420b-a70f-8417fe1da07a\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") "
Jul 07 22:37:42.681032 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.680805    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18590473-cbe7-420b-a70f-8417fe1da07a-openshift-service-ca\") pod \"18590473-cbe7-420b-a70f-8417fe1da07a\" (UID: \"18590473-cbe7-420b-a70f-8417fe1da07a\") "
Jul 07 22:37:42.681484 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.681458    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18590473-cbe7-420b-a70f-8417fe1da07a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18590473-cbe7-420b-a70f-8417fe1da07a" (UID: "18590473-cbe7-420b-a70f-8417fe1da07a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:37:42.684010 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.683982    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18590473-cbe7-420b-a70f-8417fe1da07a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18590473-cbe7-420b-a70f-8417fe1da07a" (UID: "18590473-cbe7-420b-a70f-8417fe1da07a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:37:42.684093 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.684002    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18590473-cbe7-420b-a70f-8417fe1da07a-kube-api-access-npkkf" (OuterVolumeSpecName: "kube-api-access-npkkf") pod "18590473-cbe7-420b-a70f-8417fe1da07a" (UID: "18590473-cbe7-420b-a70f-8417fe1da07a"). InnerVolumeSpecName "kube-api-access-npkkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:37:42.782336 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.782289    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npkkf\" (UniqueName: \"kubernetes.io/projected/18590473-cbe7-420b-a70f-8417fe1da07a-kube-api-access-npkkf\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:42.782336 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.782332    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18590473-cbe7-420b-a70f-8417fe1da07a-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:42.782554 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.782347    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18590473-cbe7-420b-a70f-8417fe1da07a-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:42.928942 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.928912    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"]
Jul 07 22:37:42.934656 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:42.934589    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f6520f-7666c5c555-r9vkb"]
Jul 07 22:37:43.255364 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:43.254878    2573 patch_prober.go:28] interesting pod/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 22:37:43.255364 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:43.254943    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 22:37:43.504333 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:43.504299    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18590473-cbe7-420b-a70f-8417fe1da07a" path="/var/lib/kubelet/pods/18590473-cbe7-420b-a70f-8417fe1da07a/volumes"
Jul 07 22:37:44.258812 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:44.258771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:44.259256 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:44.259240    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:44.259947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:44.259926    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:47.847293 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:47.847262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:47.948000 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:47.947964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:48.099538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:48.099451    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"]
Jul 07 22:37:48.099690 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:48.099631    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy" containerID="cri-o://1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834" gracePeriod=30
Jul 07 22:37:48.114281 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:48.114247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:48.336523 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:48.336487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:48.679444 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:48.679414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:48.977217 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:48.977064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:49.423546 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:49.423515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:51.902525 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.902486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:51.965621 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.965589    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"]
Jul 07 22:37:51.966010 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.965997    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" containerName="maas-api"
Jul 07 22:37:51.966062 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.966011    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" containerName="maas-api"
Jul 07 22:37:51.966062 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.966033    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18590473-cbe7-420b-a70f-8417fe1da07a" containerName="maas-api"
Jul 07 22:37:51.966062 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.966039    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="18590473-cbe7-420b-a70f-8417fe1da07a" containerName="maas-api"
Jul 07 22:37:51.966178 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.966099    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="18590473-cbe7-420b-a70f-8417fe1da07a" containerName="maas-api"
Jul 07 22:37:51.966178 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.966109    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e74cb0c-d5a8-496e-ae8a-cd4f60b39a97" containerName="maas-api"
Jul 07 22:37:51.970579 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.970559    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:51.972808 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.972788    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-41e952-serving-cert\""
Jul 07 22:37:51.976835 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.976812    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"]
Jul 07 22:37:51.981529 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:51.981497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:52.049478 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.049449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:52.074857 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.074818    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/107065cd-7ff4-4108-889e-ab5960b1f6a5-maas-api-tls\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.075075 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.075024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/107065cd-7ff4-4108-889e-ab5960b1f6a5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.075075 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.075066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s99zw\" (UniqueName: \"kubernetes.io/projected/107065cd-7ff4-4108-889e-ab5960b1f6a5-kube-api-access-s99zw\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.176342 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.176258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/107065cd-7ff4-4108-889e-ab5960b1f6a5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.176342 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.176295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s99zw\" (UniqueName: \"kubernetes.io/projected/107065cd-7ff4-4108-889e-ab5960b1f6a5-kube-api-access-s99zw\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.176529 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.176400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/107065cd-7ff4-4108-889e-ab5960b1f6a5-maas-api-tls\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.176921 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.176899    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/107065cd-7ff4-4108-889e-ab5960b1f6a5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.178985 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.178960    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/107065cd-7ff4-4108-889e-ab5960b1f6a5-maas-api-tls\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.184126 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.184099    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s99zw\" (UniqueName: \"kubernetes.io/projected/107065cd-7ff4-4108-889e-ab5960b1f6a5-kube-api-access-s99zw\") pod \"maas-api-e2e-shared-a-41e952-98c884f74-wdx4l\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") " pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.219306 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.219278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:52.283699 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.283668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:52.427255 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.427148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:52.435892 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.435871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"]
Jul 07 22:37:52.438229 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:37:52.438184    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107065cd_7ff4_4108_889e_ab5960b1f6a5.slice/crio-88a858e117b39dffd142f5956de3b50747a34c68fd359f8d8b5c56f219d37d75 WatchSource:0}: Error finding container 88a858e117b39dffd142f5956de3b50747a34c68fd359f8d8b5c56f219d37d75: Status 404 returned error can't find the container with id 88a858e117b39dffd142f5956de3b50747a34c68fd359f8d8b5c56f219d37d75
Jul 07 22:37:52.529357 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.529315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:52.663032 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:52.662997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l" event={"ID":"107065cd-7ff4-4108-889e-ab5960b1f6a5","Type":"ContainerStarted","Data":"88a858e117b39dffd142f5956de3b50747a34c68fd359f8d8b5c56f219d37d75"}
Jul 07 22:37:53.367375 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.367307    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:53.491757 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491719    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-socket\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491757 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491762    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-podinfo\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491789    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj8xz\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-kube-api-access-fj8xz\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491804    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istiod-ca-cert\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491850    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-credential-socket\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491867    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-token\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491884    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-certs\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491922    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-data\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.491995 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.491956    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-envoy\") pod \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\" (UID: \"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09\") "
Jul 07 22:37:53.492376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.492052    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:53.492376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.492246    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:53.492376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.492333    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-credential-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.492376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.492352    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-socket\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.492548 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.492492    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:37:53.492681 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.492643    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:53.493242 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.493192    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:53.494446 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.494416    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:37:53.494446 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.494422    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:37:53.494563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.494440    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-kube-api-access-fj8xz" (OuterVolumeSpecName: "kube-api-access-fj8xz") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "kube-api-access-fj8xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:37:53.494563 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.494467    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" (UID: "cfa8e534-7d92-4c1f-85cb-c8c9292a0c09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:37:53.593070 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.593030    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-data\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.593070 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.593060    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-envoy\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.593070 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.593070    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-podinfo\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.593070 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.593079    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj8xz\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-kube-api-access-fj8xz\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.593430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.593087    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istiod-ca-cert\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.593430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.593095    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-istio-token\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.593430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.593102    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09-workload-certs\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:37:53.670101 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.670015    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerID="1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834" exitCode=0
Jul 07 22:37:53.670101 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.670067    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"
Jul 07 22:37:53.670368 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.670097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" event={"ID":"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09","Type":"ContainerDied","Data":"1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834"}
Jul 07 22:37:53.670368 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.670149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5" event={"ID":"cfa8e534-7d92-4c1f-85cb-c8c9292a0c09","Type":"ContainerDied","Data":"30e0ad63aa4fd9b28829ad39c94fb242073361c572d6bb739216a1b559b58bd0"}
Jul 07 22:37:53.670368 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.670183    2573 scope.go:117] "RemoveContainer" containerID="1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834"
Jul 07 22:37:53.671859 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.671825    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l" event={"ID":"107065cd-7ff4-4108-889e-ab5960b1f6a5","Type":"ContainerStarted","Data":"c654d4bbda39c3dea7b14b6cb34e0cd76c171f1a826abe08d088cc37795d17f0"}
Jul 07 22:37:53.671994 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.671974    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:53.679573 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.679557    2573 scope.go:117] "RemoveContainer" containerID="7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6"
Jul 07 22:37:53.686089 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.686063    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"]
Jul 07 22:37:53.687764 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.687750    2573 scope.go:117] "RemoveContainer" containerID="1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834"
Jul 07 22:37:53.687998 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:37:53.687982    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834\": container with ID starting with 1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834 not found: ID does not exist" containerID="1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834"
Jul 07 22:37:53.688044 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.688006    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834"} err="failed to get container status \"1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834\": rpc error: code = NotFound desc = could not find container \"1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834\": container with ID starting with 1a12ee22460705eb8989f49b120f3cd3b51c496701946c735e7e37c624a43834 not found: ID does not exist"
Jul 07 22:37:53.688044 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.688024    2573 scope.go:117] "RemoveContainer" containerID="7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6"
Jul 07 22:37:53.688285 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:37:53.688266    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6\": container with ID starting with 7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6 not found: ID does not exist" containerID="7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6"
Jul 07 22:37:53.688339 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.688292    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6"} err="failed to get container status \"7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6\": rpc error: code = NotFound desc = could not find container \"7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6\": container with ID starting with 7eab18e56a84338c484467e6792937d35f5c903c2a8640e86fe46580d76e6bb6 not found: ID does not exist"
Jul 07 22:37:53.691153 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.691135    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f6520f-openshift-default-789b7b9fc9-wk5m5"]
Jul 07 22:37:53.704058 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:53.704010    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l" podStartSLOduration=2.419810938 podStartE2EDuration="2.703997588s" totalImagesPullingTime="284.18665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:37:53.70263024 +0000 UTC m=+2054.712569446" watchObservedRunningTime="2026-07-07 22:37:53.703997588 +0000 UTC m=+2054.713936766"
Jul 07 22:37:55.504808 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:55.504773    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" path="/var/lib/kubelet/pods/cfa8e534-7d92-4c1f-85cb-c8c9292a0c09/volumes"
Jul 07 22:37:56.178955 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:56.178913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:56.378663 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:56.378631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:56.719448 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:56.719412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:57.003738 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:57.003710    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:57.327900 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:57.327816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:37:59.683792 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:59.683704    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:37:59.970258 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:37:59.970127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:00.063629 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.063593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:00.216596 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.216561    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"]
Jul 07 22:38:00.217186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.217159    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy"
Jul 07 22:38:00.217186 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.217186    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy"
Jul 07 22:38:00.217435 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.217220    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy"
Jul 07 22:38:00.217435 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.217230    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy"
Jul 07 22:38:00.217435 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.217316    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy"
Jul 07 22:38:00.217435 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.217329    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfa8e534-7d92-4c1f-85cb-c8c9292a0c09" containerName="istio-proxy"
Jul 07 22:38:00.221887 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.221822    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.224042 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.224022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-a4bfe6-serving-cert\""
Jul 07 22:38:00.229849 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.229822    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"]
Jul 07 22:38:00.260501 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.260461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:00.361916 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.361877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af20e21-27a6-4858-91fd-14b89d8b97fd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.362092 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.361941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swxrb\" (UniqueName: \"kubernetes.io/projected/6af20e21-27a6-4858-91fd-14b89d8b97fd-kube-api-access-swxrb\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.362092 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.362016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6af20e21-27a6-4858-91fd-14b89d8b97fd-maas-api-tls\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.434370 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.434338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:00.463592 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.463554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swxrb\" (UniqueName: \"kubernetes.io/projected/6af20e21-27a6-4858-91fd-14b89d8b97fd-kube-api-access-swxrb\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.463773 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.463623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6af20e21-27a6-4858-91fd-14b89d8b97fd-maas-api-tls\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.463773 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.463729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af20e21-27a6-4858-91fd-14b89d8b97fd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.464381 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.464362    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af20e21-27a6-4858-91fd-14b89d8b97fd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.466347 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.466324    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6af20e21-27a6-4858-91fd-14b89d8b97fd-maas-api-tls\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.472071 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.472009    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swxrb\" (UniqueName: \"kubernetes.io/projected/6af20e21-27a6-4858-91fd-14b89d8b97fd-kube-api-access-swxrb\") pod \"maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") " pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.535043 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.535007    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:00.676334 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.676311    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"]
Jul 07 22:38:00.678976 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:38:00.678939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af20e21_27a6_4858_91fd_14b89d8b97fd.slice/crio-ea6682723f91baa809108fada4f969e9f3fa8cd86a27db65b8aaae3e185fcf0f WatchSource:0}: Error finding container ea6682723f91baa809108fada4f969e9f3fa8cd86a27db65b8aaae3e185fcf0f: Status 404 returned error can't find the container with id ea6682723f91baa809108fada4f969e9f3fa8cd86a27db65b8aaae3e185fcf0f
Jul 07 22:38:00.709226 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.709174    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2" event={"ID":"6af20e21-27a6-4858-91fd-14b89d8b97fd","Type":"ContainerStarted","Data":"ea6682723f91baa809108fada4f969e9f3fa8cd86a27db65b8aaae3e185fcf0f"}
Jul 07 22:38:00.745511 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.745419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:00.848398 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:00.848360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:01.716069 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:01.716036    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2" event={"ID":"6af20e21-27a6-4858-91fd-14b89d8b97fd","Type":"ContainerStarted","Data":"6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58"}
Jul 07 22:38:01.716520 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:01.716179    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:01.732660 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:01.732611    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2" podStartSLOduration=1.4048664880000001 podStartE2EDuration="1.732596047s" totalImagesPullingTime="327.729559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:38:01.73130835 +0000 UTC m=+2062.741247529" watchObservedRunningTime="2026-07-07 22:38:01.732596047 +0000 UTC m=+2062.742535264"
Jul 07 22:38:04.439672 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:04.439638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:07.727455 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:07.727423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:38:13.235154 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:13.235116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:13.335968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:13.335933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:15.943283 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:15.943249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:22.087059 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:22.087012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:22.187515 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:22.187478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:39.532601 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:39.532575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:38:39.538864 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:39.538840    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:38:44.098371 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:44.098335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:45.349562 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:45.349528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:38:51.146535 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:38:51.146499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:39:01.537964 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:39:01.537927    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:39:01.587752 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:39:01.587718    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:40:44.139945 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:40:44.139907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:40:44.440264 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:40:44.440173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:40:45.316444 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:40:45.316408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:40:59.810630 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:40:59.810539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:41:33.810766 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:41:33.810732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:19.555734 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:19.555691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:20.518735 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:20.518676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:27.138095 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:27.138059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:27.244075 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:27.244027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:33.749426 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:33.749324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:50.637091 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:50.637056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:56.176599 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:56.176541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:42:56.277128 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:42:56.277091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:13.919951 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:13.919916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:14.018943 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:14.018880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:22.745051 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:22.744975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:22.845023 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:22.844967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:33.455862 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:33.455817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:34.345373 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:34.345336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:35.365147 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:35.365084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:35.765335 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:35.765288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:35.864986 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:35.864946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:35.965525 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:35.965488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:36.045705 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.045614    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"]
Jul 07 22:43:36.045866 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.045829    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l" podUID="107065cd-7ff4-4108-889e-ab5960b1f6a5" containerName="maas-api" containerID="cri-o://c654d4bbda39c3dea7b14b6cb34e0cd76c171f1a826abe08d088cc37795d17f0" gracePeriod=30
Jul 07 22:43:36.068063 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.068002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:36.416027 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.415993    2573 generic.go:356] "Generic (PLEG): container finished" podID="107065cd-7ff4-4108-889e-ab5960b1f6a5" containerID="c654d4bbda39c3dea7b14b6cb34e0cd76c171f1a826abe08d088cc37795d17f0" exitCode=0
Jul 07 22:43:36.416434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.416067    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l" event={"ID":"107065cd-7ff4-4108-889e-ab5960b1f6a5","Type":"ContainerDied","Data":"c654d4bbda39c3dea7b14b6cb34e0cd76c171f1a826abe08d088cc37795d17f0"}
Jul 07 22:43:36.507613 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.507588    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:43:36.700284 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.700162    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/107065cd-7ff4-4108-889e-ab5960b1f6a5-openshift-service-ca\") pod \"107065cd-7ff4-4108-889e-ab5960b1f6a5\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") "
Jul 07 22:43:36.700284 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.700257    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/107065cd-7ff4-4108-889e-ab5960b1f6a5-maas-api-tls\") pod \"107065cd-7ff4-4108-889e-ab5960b1f6a5\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") "
Jul 07 22:43:36.700479 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.700291    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s99zw\" (UniqueName: \"kubernetes.io/projected/107065cd-7ff4-4108-889e-ab5960b1f6a5-kube-api-access-s99zw\") pod \"107065cd-7ff4-4108-889e-ab5960b1f6a5\" (UID: \"107065cd-7ff4-4108-889e-ab5960b1f6a5\") "
Jul 07 22:43:36.700572 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.700548    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/107065cd-7ff4-4108-889e-ab5960b1f6a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "107065cd-7ff4-4108-889e-ab5960b1f6a5" (UID: "107065cd-7ff4-4108-889e-ab5960b1f6a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:43:36.702535 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.702507    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/107065cd-7ff4-4108-889e-ab5960b1f6a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "107065cd-7ff4-4108-889e-ab5960b1f6a5" (UID: "107065cd-7ff4-4108-889e-ab5960b1f6a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:43:36.702644 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.702579    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/107065cd-7ff4-4108-889e-ab5960b1f6a5-kube-api-access-s99zw" (OuterVolumeSpecName: "kube-api-access-s99zw") pod "107065cd-7ff4-4108-889e-ab5960b1f6a5" (UID: "107065cd-7ff4-4108-889e-ab5960b1f6a5"). InnerVolumeSpecName "kube-api-access-s99zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:43:36.801169 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.801133    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/107065cd-7ff4-4108-889e-ab5960b1f6a5-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:43:36.801169 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.801170    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/107065cd-7ff4-4108-889e-ab5960b1f6a5-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:43:36.801403 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:36.801179    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s99zw\" (UniqueName: \"kubernetes.io/projected/107065cd-7ff4-4108-889e-ab5960b1f6a5-kube-api-access-s99zw\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:43:37.422723 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:37.422691    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"
Jul 07 22:43:37.422723 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:37.422707    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l" event={"ID":"107065cd-7ff4-4108-889e-ab5960b1f6a5","Type":"ContainerDied","Data":"88a858e117b39dffd142f5956de3b50747a34c68fd359f8d8b5c56f219d37d75"}
Jul 07 22:43:37.423287 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:37.422770    2573 scope.go:117] "RemoveContainer" containerID="c654d4bbda39c3dea7b14b6cb34e0cd76c171f1a826abe08d088cc37795d17f0"
Jul 07 22:43:37.444342 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:37.444314    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"]
Jul 07 22:43:37.446250 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:37.446225    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-41e952-98c884f74-wdx4l"]
Jul 07 22:43:37.504461 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:37.504428    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="107065cd-7ff4-4108-889e-ab5960b1f6a5" path="/var/lib/kubelet/pods/107065cd-7ff4-4108-889e-ab5960b1f6a5/volumes"
Jul 07 22:43:39.562820 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:39.562785    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:43:39.570425 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:39.570402    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9qk8_2407265e-b9c0-44bd-9cf8-7dad898eb0e8/ovn-acl-logging/0.log"
Jul 07 22:43:40.842429 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:40.842394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:43.008430 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:43.008393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:43:53.638696 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:43:53.638664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:15.824544 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:15.824454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:15.873269 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:15.873231    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:17.565265 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:17.565225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:17.906896 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:17.906815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:18.097254 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:18.097189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:18.249962 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:18.249927    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:18.664832 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:18.664715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:18.821141 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:18.821105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:18.922373 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:18.922274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:19.036192 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.036159    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"]
Jul 07 22:44:19.036503 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.036471    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2" podUID="6af20e21-27a6-4858-91fd-14b89d8b97fd" containerName="maas-api" containerID="cri-o://6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58" gracePeriod=30
Jul 07 22:44:19.063692 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.063664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:19.290621 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.290594    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:44:19.398715 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.398679    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af20e21-27a6-4858-91fd-14b89d8b97fd-openshift-service-ca\") pod \"6af20e21-27a6-4858-91fd-14b89d8b97fd\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") "
Jul 07 22:44:19.398916 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.398736    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6af20e21-27a6-4858-91fd-14b89d8b97fd-maas-api-tls\") pod \"6af20e21-27a6-4858-91fd-14b89d8b97fd\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") "
Jul 07 22:44:19.398916 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.398803    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swxrb\" (UniqueName: \"kubernetes.io/projected/6af20e21-27a6-4858-91fd-14b89d8b97fd-kube-api-access-swxrb\") pod \"6af20e21-27a6-4858-91fd-14b89d8b97fd\" (UID: \"6af20e21-27a6-4858-91fd-14b89d8b97fd\") "
Jul 07 22:44:19.399139 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.399110    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af20e21-27a6-4858-91fd-14b89d8b97fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6af20e21-27a6-4858-91fd-14b89d8b97fd" (UID: "6af20e21-27a6-4858-91fd-14b89d8b97fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:44:19.401065 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.401040    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af20e21-27a6-4858-91fd-14b89d8b97fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6af20e21-27a6-4858-91fd-14b89d8b97fd" (UID: "6af20e21-27a6-4858-91fd-14b89d8b97fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:44:19.401145 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.401070    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af20e21-27a6-4858-91fd-14b89d8b97fd-kube-api-access-swxrb" (OuterVolumeSpecName: "kube-api-access-swxrb") pod "6af20e21-27a6-4858-91fd-14b89d8b97fd" (UID: "6af20e21-27a6-4858-91fd-14b89d8b97fd"). InnerVolumeSpecName "kube-api-access-swxrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:44:19.500581 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.500541    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af20e21-27a6-4858-91fd-14b89d8b97fd-openshift-service-ca\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:44:19.500581 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.500572    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6af20e21-27a6-4858-91fd-14b89d8b97fd-maas-api-tls\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:44:19.500776 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.500588    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swxrb\" (UniqueName: \"kubernetes.io/projected/6af20e21-27a6-4858-91fd-14b89d8b97fd-kube-api-access-swxrb\") on node \"ip-10-0-139-213.ec2.internal\" DevicePath \"\""
Jul 07 22:44:19.635076 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.635044    2573 generic.go:356] "Generic (PLEG): container finished" podID="6af20e21-27a6-4858-91fd-14b89d8b97fd" containerID="6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58" exitCode=0
Jul 07 22:44:19.635298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.635090    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"
Jul 07 22:44:19.635298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.635135    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2" event={"ID":"6af20e21-27a6-4858-91fd-14b89d8b97fd","Type":"ContainerDied","Data":"6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58"}
Jul 07 22:44:19.635298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.635189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2" event={"ID":"6af20e21-27a6-4858-91fd-14b89d8b97fd","Type":"ContainerDied","Data":"ea6682723f91baa809108fada4f969e9f3fa8cd86a27db65b8aaae3e185fcf0f"}
Jul 07 22:44:19.635298 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.635233    2573 scope.go:117] "RemoveContainer" containerID="6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58"
Jul 07 22:44:19.644576 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.644556    2573 scope.go:117] "RemoveContainer" containerID="6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58"
Jul 07 22:44:19.644848 ip-10-0-139-213 kubenswrapper[2573]: E0707 22:44:19.644828    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58\": container with ID starting with 6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58 not found: ID does not exist" containerID="6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58"
Jul 07 22:44:19.644895 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.644857    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58"} err="failed to get container status \"6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58\": rpc error: code = NotFound desc = could not find container \"6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58\": container with ID starting with 6aceb4522d29d5b07da289fd12f0230cb93f5c813bd609d84b1f141791c99f58 not found: ID does not exist"
Jul 07 22:44:19.650771 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.650743    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"]
Jul 07 22:44:19.655873 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:19.655841    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a4bfe6-5c649cff9-x7tx2"]
Jul 07 22:44:21.503831 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:21.503797    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6af20e21-27a6-4858-91fd-14b89d8b97fd" path="/var/lib/kubelet/pods/6af20e21-27a6-4858-91fd-14b89d8b97fd/volumes"
Jul 07 22:44:24.362095 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:24.362056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:24.475038 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:24.475003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:24.631144 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:24.631052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:24.836782 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:24.836730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:29.997743 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:29.997707    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lk5d2_3f175459-330e-4d31-aa64-2d8951b9c15b/manager/0.log"
Jul 07 22:44:30.125947 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:30.125913    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c5hxx_0f67602f-c33f-47f1-bfb5-90a511b13cc4/manager/0.log"
Jul 07 22:44:30.244660 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:30.244610    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dcd777f48-28znx_4145ed70-fb11-4335-ab36-8467c737e1d0/maas-api/0.log"
Jul 07 22:44:30.601376 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:30.601324    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6646f4f865-pqwjb_88cdccf1-954c-4dfd-af99-436bd974d48b/manager/0.log"
Jul 07 22:44:30.719233 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:30.719207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-g9b7j_fd6f1e60-e28b-422f-ac08-6b63e1d0d344/server/0.log"
Jul 07 22:44:30.847963 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:30.847897    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7qbxq_94b8548e-7835-4a3b-a34b-5809dd1d60a6/manager/0.log"
Jul 07 22:44:31.089714 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:31.089684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597db99f65-gtstn_009145dc-6fee-4808-9637-8974f7bf1ac7/copy-manifests/0.log"
Jul 07 22:44:31.095960 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:31.095934    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597db99f65-gtstn_009145dc-6fee-4808-9637-8974f7bf1ac7/manager/0.log"
Jul 07 22:44:31.334225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:31.334174    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-6kn2g_c2ed8832-cbf0-4951-b321-3900f4ef8b1f/postgres/0.log"
Jul 07 22:44:32.722426 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:32.722392    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tjccf_2a20f023-a69e-41b7-a87e-691f7fc54092/manager/0.log"
Jul 07 22:44:33.064108 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:33.064075    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4djgz_7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4/registry-server/0.log"
Jul 07 22:44:33.191538 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:33.191504    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2b6zj_b8048158-4d11-4763-8d91-6cdadad2b01f/manager/0.log"
Jul 07 22:44:33.790876 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:33.790846    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dc46s_c2307f1e-822e-4ec5-a8c0-501aa4b584b0/istio-proxy/0.log"
Jul 07 22:44:34.134408 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:34.134316    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b4fccd749-bk5dl_79e88f6b-cd26-45f2-89c9-c04b6defd3e8/kube-auth-proxy/0.log"
Jul 07 22:44:34.264032 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:34.264000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5ftk9_22c50aa0-937b-4df5-975d-1cba8282e074/istio-proxy/1.log"
Jul 07 22:44:34.390112 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:34.390017    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n8mzv_e788e6af-11b8-4ac1-b9ed-582f39138c86/payload-pre-processing/0.log"
Jul 07 22:44:34.518852 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:34.518817    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7djc7_c6c41c43-6538-4460-b108-04f47d8ef440/payload-processing/0.log"
Jul 07 22:44:34.987882 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:34.987854    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kzfkj_a7df73e2-c031-4669-a3cf-1f16355c07db/main/0.log"
Jul 07 22:44:35.324036 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:35.324011    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8nq85_a66919ba-f7bb-493a-a4ea-fdfd75f43e26/main/0.log"
Jul 07 22:44:35.435307 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:35.435269    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-v8mrb_6430fedc-0324-4991-8f05-f7b417d17a0e/main/0.log"
Jul 07 22:44:39.604318 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:39.604279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:39.670283 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:39.670245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log" limit=1024
Jul 07 22:44:42.560819 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:42.560784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vp95t_45732897-8b95-499a-ba59-0fa7dd838e43/global-pull-secret-syncer/0.log"
Jul 07 22:44:42.612526 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:42.612497    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7nskk_b58bf2c7-55ae-4cfe-a6f2-6f1bbd7bc2fd/konnectivity-agent/0.log"
Jul 07 22:44:42.744042 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:42.744007    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-213.ec2.internal_2a83507c3630b4c4defb443358b1b6c0/haproxy/0.log"
Jul 07 22:44:48.081106 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:48.081040    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tjccf_2a20f023-a69e-41b7-a87e-691f7fc54092/manager/0.log"
Jul 07 22:44:48.181259 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:48.181225    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4djgz_7e4ec9b4-a2ca-4ac2-9d98-62d0ebe326e4/registry-server/0.log"
Jul 07 22:44:48.343420 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:48.343330    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2b6zj_b8048158-4d11-4763-8d91-6cdadad2b01f/manager/0.log"
Jul 07 22:44:50.218788 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:50.218747    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-94mjg_96ee12d4-97f6-4312-abe7-825cc500e3fa/cluster-monitoring-operator/0.log"
Jul 07 22:44:50.337843 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:50.337808    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-d4tl5_ce3b5bba-5377-4892-96fb-97b17f9a5315/monitoring-plugin/0.log"
Jul 07 22:44:50.387124 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:50.387085    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6d7pt_b0b4b488-5d82-4527-89f1-f6eea8acbcd7/node-exporter/0.log"
Jul 07 22:44:50.406870 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:50.406841    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6d7pt_b0b4b488-5d82-4527-89f1-f6eea8acbcd7/kube-rbac-proxy/0.log"
Jul 07 22:44:50.426895 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:50.426866    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6d7pt_b0b4b488-5d82-4527-89f1-f6eea8acbcd7/init-textfile/0.log"
Jul 07 22:44:52.200576 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.200543    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-nhd7r_96795654-e144-4b33-941f-108a130aeed3/networking-console-plugin/0.log"
Jul 07 22:44:52.506109 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.506075    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"]
Jul 07 22:44:52.506532 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.506515    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="107065cd-7ff4-4108-889e-ab5960b1f6a5" containerName="maas-api"
Jul 07 22:44:52.506532 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.506533    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="107065cd-7ff4-4108-889e-ab5960b1f6a5" containerName="maas-api"
Jul 07 22:44:52.506693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.506553    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af20e21-27a6-4858-91fd-14b89d8b97fd" containerName="maas-api"
Jul 07 22:44:52.506693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.506559    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af20e21-27a6-4858-91fd-14b89d8b97fd" containerName="maas-api"
Jul 07 22:44:52.506693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.506613    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="107065cd-7ff4-4108-889e-ab5960b1f6a5" containerName="maas-api"
Jul 07 22:44:52.506693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.506620    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af20e21-27a6-4858-91fd-14b89d8b97fd" containerName="maas-api"
Jul 07 22:44:52.509772 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.509753    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.511949 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.511931    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzlgw\"/\"kube-root-ca.crt\""
Jul 07 22:44:52.512072 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.511970    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzlgw\"/\"openshift-service-ca.crt\""
Jul 07 22:44:52.512846 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.512828    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kzlgw\"/\"default-dockercfg-7bpws\""
Jul 07 22:44:52.518990 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.518966    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"]
Jul 07 22:44:52.583422 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.583384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-lib-modules\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.583610 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.583497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-proc\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.583610 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.583560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-752xx\" (UniqueName: \"kubernetes.io/projected/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-kube-api-access-752xx\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.583610 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.583598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-podres\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.583741 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.583723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-sys\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684797 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-proc\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-752xx\" (UniqueName: \"kubernetes.io/projected/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-kube-api-access-752xx\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-podres\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-sys\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684889    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-proc\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-lib-modules\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684964    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-sys\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.684999 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.684983    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-lib-modules\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.685360 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.685047    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-podres\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.692533 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.692503    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-752xx\" (UniqueName: \"kubernetes.io/projected/f4db907a-4c5d-42a4-b7d8-e788ea1b38e5-kube-api-access-752xx\") pod \"perf-node-gather-daemonset-c4gc4\" (UID: \"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5\") " pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.820406 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.820321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:52.959522 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:52.959491    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"]
Jul 07 22:44:52.961967 ip-10-0-139-213 kubenswrapper[2573]: W0707 22:44:52.961939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf4db907a_4c5d_42a4_b7d8_e788ea1b38e5.slice/crio-9a478a18b5a038c49947e7b0b70f61523b4d93be5023560c1555ca545713cff7 WatchSource:0}: Error finding container 9a478a18b5a038c49947e7b0b70f61523b4d93be5023560c1555ca545713cff7: Status 404 returned error can't find the container with id 9a478a18b5a038c49947e7b0b70f61523b4d93be5023560c1555ca545713cff7
Jul 07 22:44:53.400409 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:53.400375    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-864b6df6b4-p8spn_7bc83e63-3659-4272-b2d6-4309bc1d1d9a/console/0.log"
Jul 07 22:44:53.808434 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:53.808397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4" event={"ID":"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5","Type":"ContainerStarted","Data":"271c7b814579c47e04b8aaaed486c7a46d724c2fed02b4def3be09cf3fc93f9a"}
Jul 07 22:44:53.808637 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:53.808451    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4" event={"ID":"f4db907a-4c5d-42a4-b7d8-e788ea1b38e5","Type":"ContainerStarted","Data":"9a478a18b5a038c49947e7b0b70f61523b4d93be5023560c1555ca545713cff7"}
Jul 07 22:44:53.808637 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:53.808473    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:44:53.822885 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:53.822832    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4" podStartSLOduration=1.822813938 podStartE2EDuration="1.822813938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:44:53.822016727 +0000 UTC m=+2474.831955905" watchObservedRunningTime="2026-07-07 22:44:53.822813938 +0000 UTC m=+2474.832753121"
Jul 07 22:44:55.006291 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:55.006261    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q8w4_9b44371e-723d-447f-b561-b905c2c22dc2/dns/0.log"
Jul 07 22:44:55.027796 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:55.027763    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q8w4_9b44371e-723d-447f-b561-b905c2c22dc2/kube-rbac-proxy/0.log"
Jul 07 22:44:55.178437 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:55.178407    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-st2hx_2c3ab11d-324d-413c-b281-5ccef1f98d5e/dns-node-resolver/0.log"
Jul 07 22:44:55.752280 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:55.752251    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-chd6x_0173042e-1df4-4045-a58a-eec59e695ab4/node-ca/0.log"
Jul 07 22:44:56.655739 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:56.655684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dc46s_c2307f1e-822e-4ec5-a8c0-501aa4b584b0/istio-proxy/0.log"
Jul 07 22:44:56.881975 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:56.881947    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b4fccd749-bk5dl_79e88f6b-cd26-45f2-89c9-c04b6defd3e8/kube-auth-proxy/0.log"
Jul 07 22:44:56.910007 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:56.909913    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5ftk9_22c50aa0-937b-4df5-975d-1cba8282e074/istio-proxy/0.log"
Jul 07 22:44:56.967756 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:56.967724    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5ftk9_22c50aa0-937b-4df5-975d-1cba8282e074/istio-proxy/1.log"
Jul 07 22:44:57.011279 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:57.011233    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n8mzv_e788e6af-11b8-4ac1-b9ed-582f39138c86/payload-pre-processing/0.log"
Jul 07 22:44:57.088127 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:57.088089    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7djc7_c6c41c43-6538-4460-b108-04f47d8ef440/payload-processing/0.log"
Jul 07 22:44:57.809438 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:57.809396    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jhlwf_c4693966-f5e2-4ec8-89e0-8276685f4770/serve-healthcheck-canary/0.log"
Jul 07 22:44:58.281705 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:58.281670    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-65lxg_5c0f4165-dc58-4c3c-a01e-c10a38f0506e/insights-operator/0.log"
Jul 07 22:44:58.281968 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:58.281950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-65lxg_5c0f4165-dc58-4c3c-a01e-c10a38f0506e/insights-operator/1.log"
Jul 07 22:44:58.437328 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:58.437295    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ltc46_b04ba8b7-0260-4da4-a19c-d91873f00f5b/kube-rbac-proxy/0.log"
Jul 07 22:44:58.456742 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:58.456708    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ltc46_b04ba8b7-0260-4da4-a19c-d91873f00f5b/exporter/0.log"
Jul 07 22:44:58.475455 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:58.475428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ltc46_b04ba8b7-0260-4da4-a19c-d91873f00f5b/extractor/0.log"
Jul 07 22:44:59.824679 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:44:59.824651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kzlgw/perf-node-gather-daemonset-c4gc4"
Jul 07 22:45:00.557824 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:00.557790    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lk5d2_3f175459-330e-4d31-aa64-2d8951b9c15b/manager/0.log"
Jul 07 22:45:00.797953 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:00.797915    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c5hxx_0f67602f-c33f-47f1-bfb5-90a511b13cc4/manager/0.log"
Jul 07 22:45:00.845740 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:00.845653    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dcd777f48-28znx_4145ed70-fb11-4335-ab36-8467c737e1d0/maas-api/0.log"
Jul 07 22:45:01.076225 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:01.076181    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6646f4f865-pqwjb_88cdccf1-954c-4dfd-af99-436bd974d48b/manager/0.log"
Jul 07 22:45:01.098911 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:01.098828    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-g9b7j_fd6f1e60-e28b-422f-ac08-6b63e1d0d344/server/0.log"
Jul 07 22:45:01.201630 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:01.201600    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7qbxq_94b8548e-7835-4a3b-a34b-5809dd1d60a6/manager/0.log"
Jul 07 22:45:01.356402 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:01.356281    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597db99f65-gtstn_009145dc-6fee-4808-9637-8974f7bf1ac7/manager/0.log"
Jul 07 22:45:01.378660 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:01.378625    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597db99f65-gtstn_009145dc-6fee-4808-9637-8974f7bf1ac7/copy-manifests/0.log"
Jul 07 22:45:01.459867 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:01.459840    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-6kn2g_c2ed8832-cbf0-4951-b321-3900f4ef8b1f/postgres/0.log"
Jul 07 22:45:02.808360 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:02.808323    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dc46s_c2307f1e-822e-4ec5-a8c0-501aa4b584b0/istio-proxy/0.log"
Jul 07 22:45:02.979100 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:02.979004    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lpk8v_8f922b20-0411-4814-867c-62f499a5ba6f/openshift-lws-operator/0.log"
Jul 07 22:45:03.030881 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:03.030851    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b4fccd749-bk5dl_79e88f6b-cd26-45f2-89c9-c04b6defd3e8/kube-auth-proxy/0.log"
Jul 07 22:45:03.054815 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:03.054787    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5ftk9_22c50aa0-937b-4df5-975d-1cba8282e074/istio-proxy/0.log"
Jul 07 22:45:03.111152 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:03.111117    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5ftk9_22c50aa0-937b-4df5-975d-1cba8282e074/istio-proxy/1.log"
Jul 07 22:45:03.137578 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:03.137548    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n8mzv_e788e6af-11b8-4ac1-b9ed-582f39138c86/payload-pre-processing/0.log"
Jul 07 22:45:03.207556 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:03.207519    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7djc7_c6c41c43-6538-4460-b108-04f47d8ef440/payload-processing/0.log"
Jul 07 22:45:04.446790 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:04.446702    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dc46s_c2307f1e-822e-4ec5-a8c0-501aa4b584b0/istio-proxy/0.log"
Jul 07 22:45:04.665049 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:04.665008    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b4fccd749-bk5dl_79e88f6b-cd26-45f2-89c9-c04b6defd3e8/kube-auth-proxy/0.log"
Jul 07 22:45:04.684324 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:04.684288    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5ftk9_22c50aa0-937b-4df5-975d-1cba8282e074/istio-proxy/0.log"
Jul 07 22:45:04.738598 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:04.738509    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5ftk9_22c50aa0-937b-4df5-975d-1cba8282e074/istio-proxy/1.log"
Jul 07 22:45:04.773898 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:04.773862    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-n8mzv_e788e6af-11b8-4ac1-b9ed-582f39138c86/payload-pre-processing/0.log"
Jul 07 22:45:04.842731 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:04.842696    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7djc7_c6c41c43-6538-4460-b108-04f47d8ef440/payload-processing/0.log"
Jul 07 22:45:09.331108 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.331078    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqtm2_556ac2bb-399c-4b5d-9ced-fc45a4a2ab08/kube-multus-additional-cni-plugins/0.log"
Jul 07 22:45:09.351620 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.351599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqtm2_556ac2bb-399c-4b5d-9ced-fc45a4a2ab08/egress-router-binary-copy/0.log"
Jul 07 22:45:09.370819 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.370796    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqtm2_556ac2bb-399c-4b5d-9ced-fc45a4a2ab08/cni-plugins/0.log"
Jul 07 22:45:09.392914 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.392890    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqtm2_556ac2bb-399c-4b5d-9ced-fc45a4a2ab08/bond-cni-plugin/0.log"
Jul 07 22:45:09.411693 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.411671    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqtm2_556ac2bb-399c-4b5d-9ced-fc45a4a2ab08/routeoverride-cni/0.log"
Jul 07 22:45:09.430513 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.430490    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqtm2_556ac2bb-399c-4b5d-9ced-fc45a4a2ab08/whereabouts-cni-bincopy/0.log"
Jul 07 22:45:09.448714 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.448691    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqtm2_556ac2bb-399c-4b5d-9ced-fc45a4a2ab08/whereabouts-cni/0.log"
Jul 07 22:45:09.712073 ip-10-0-139-213 kubenswrapper[2573]: I0707 22:45:09.711984    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qm8br_a3792c4b-b141-4d31-883d-f52d5d2244b6/kube-multus/0.log"