Jul 27 20:57:32.617443 ip-10-0-143-7 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:57:33.033302 ip-10-0-143-7 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:57:33.033302 ip-10-0-143-7 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:57:33.033302 ip-10-0-143-7 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:57:33.033302 ip-10-0-143-7 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:57:33.033302 ip-10-0-143-7 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:57:33.034246 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.034163    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:57:33.038557 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038541    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038559    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038563    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038567    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038570    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038573    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038576    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038580    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038583    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038585    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038589    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038591    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038594    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038597    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038601    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:33.038598 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038604    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038610    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038613    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038617    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038619    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038621    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038624    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038627    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038629    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038633    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038637    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038640    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038643    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038645    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038648    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038651    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038653    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038656    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038658    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:33.038953 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038661    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038663    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038665    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038668    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038670    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038672    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038675    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038677    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038680    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038682    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038685    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038687    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038690    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038693    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038695    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038699    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038702    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038705    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038707    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038710    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:33.039545 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038712    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038715    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038718    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038721    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038723    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038726    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038728    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038733    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038737    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038740    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038742    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038745    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038747    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038750    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038752    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038755    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038757    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038760    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038762    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:33.040034 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038765    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038767    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038770    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038773    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038775    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038778    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038782    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038785    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038788    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038791    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038793    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038796    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038798    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038801    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038803    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038806    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038809    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038811    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038813    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038816    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:33.040677 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038818    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038821    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038823    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038827    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038830    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.038833    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039552    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039559    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039562    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039565    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039568    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039570    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039573    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039575    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039578    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039582    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039584    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039587    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039591    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:33.041493 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039595    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039600    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039604    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039607    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039610    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039612    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039615    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039618    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039621    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039624    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039626    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039629    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039634    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039637    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039640    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039643    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039646    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039649    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039652    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:33.042068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039655    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039657    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039661    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039664    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039668    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039671    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039675    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039678    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039680    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039683    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039686    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039688    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039692    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039694    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039697    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039700    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039702    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039705    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039707    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039710    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:33.042575 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039712    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039715    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039718    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039721    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039724    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039726    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039729    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039731    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039734    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039738    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039741    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039743    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039746    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039748    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039751    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039754    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039757    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039760    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039762    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039765    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:33.043068 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039767    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039769    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039772    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039774    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039777    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039779    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039782    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039785    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039788    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039790    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039793    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039795    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039798    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039800    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039803    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039805    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039808    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039811    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039813    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039816    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:33.043589 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039818    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039822    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039825    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039827    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039830    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039832    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.039835    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042179    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042191    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042197    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042202    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042205    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042209    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042212    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042215    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042219    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042222    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042225    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042228    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:33.044066 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042231    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042234    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042237    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042240    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042243    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042246    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042249    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042252    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042255    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042258    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042261    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042286    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042290    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042293    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042297    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042300    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042303    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042306    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042308    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042315    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:33.044558 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042317    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042320    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042323    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042326    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042329    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042332    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042335    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042337    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042340    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042343    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042345    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042348    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042351    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042353    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042356    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042359    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042361    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042366    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042371    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:33.045062 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042374    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042378    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042381    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042384    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042386    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042389    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042392    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042395    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042399    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042403    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042405    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042408    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042411    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042414    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042417    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042420    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042422    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042425    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042427    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042430    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:33.045552 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042433    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042435    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042438    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042440    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042443    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042446    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042450    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042452    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042455    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042457    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042460    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042463    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042467    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042470    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042472    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042475    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042478    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042481    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042483    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042486    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:33.046074 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042489    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042492    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042494    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042497    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042499    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042502    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042505    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.042508    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042584    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042592    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042602    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042609    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042616    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042621    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042626    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042631    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042635    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042638    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042642    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042645    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042648    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042651    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042654    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:57:33.046578 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042657    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042660    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042667    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042672    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042675    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042678    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042681    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042686    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042690    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042693    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042696    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042700    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042703    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042706    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042709    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042713    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042716    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042721    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042724    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042727    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042730    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042733    2579 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042736    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042740    2579 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042743    2579 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:57:33.047119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042746    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042749    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042752    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042756    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042759    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042762    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042765    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042768    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042771    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042774    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042778    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042781    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042784    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042787    2579 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042791    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042794    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042797    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042800    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042803    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042806    2579 flags.go:64] FLAG: --help="false"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042809    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042812    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042815    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:57:33.047769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042818    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042821    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042825    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042828    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042831    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042833    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042837    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042839    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042843    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042846    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042848    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042851    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042854    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042857    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042860    2579 flags.go:64] FLAG: --lock-file=""
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042863    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042866    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042869    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042876    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042878    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042882    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042886    2579 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042889    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042892    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:57:33.048363 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042895    2579 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042898    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042903    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042906    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042910    2579 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042914    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042916    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042920    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042923    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042926    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042929    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042932    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042940    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042943    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042946    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042949    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042952    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042957    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042960    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042963    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042967    2579 flags.go:64] FLAG: --port="10250"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042970    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042973    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0888680dc4ca00165"
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042976    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:57:33.048950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042979    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042982    2579 flags.go:64] FLAG: --register-node="true"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042985    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042989    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042992    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042996    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.042999    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043003    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043006    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043009    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043012    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043014    2579 flags.go:64] FLAG: --runonce="false"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043017    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043020    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043023    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043026    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043032    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043035    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043038    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043041    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043044    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043047    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043050    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043053    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043056    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:57:33.049600 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043059    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043062    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043069    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043072    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043075    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043079    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043082    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043085    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043089    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043092    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043095    2579 flags.go:64] FLAG: --v="2"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043099    2579 flags.go:64] FLAG: --version="false"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043103    2579 flags.go:64] FLAG: --vmodule=""
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043109    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.043112    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043270    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043274    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043278    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043281    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043283    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043286    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043288    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043291    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:33.050245 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043296    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043299    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043302    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043304    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043307    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043310    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043313    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043316    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043318    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043321    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043324    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043326    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043329    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043332    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043334    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043337    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043340    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043343    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043345    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:33.050805 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043348    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043350    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043353    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043358    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043363    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043366    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043369    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043372    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043374    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043377    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043379    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043382    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043384    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043388    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043391    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043394    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043396    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043399    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043402    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:33.051327 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043406    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043410    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043414    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043417    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043421    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043423    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043427    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043430    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043432    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043435    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043438    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043441    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043444    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043446    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043449    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043452    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043456    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043458    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043461    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043464    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:33.051794 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043466    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043469    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043471    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043474    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043477    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043480    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043484    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043487    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043489    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043492    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043494    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043497    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043500    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043503    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043507    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043510    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043512    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043516    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043520    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043523    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:33.052307 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043525    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043528    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043530    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043533    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043535    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043538    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043541    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043543    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043547    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043550    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043552    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043556    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.043559    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.044178    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.050917    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:57:33.052784 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.050935    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.050955    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.050961    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051021    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051026    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051029    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051032    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051035    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051038    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051041    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051043    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051046    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051049    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051051    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051054    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051056    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051059    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051062    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051065    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051067    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:33.053180 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051070    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051072    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051075    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051077    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051082    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051085    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051089    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051091    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051095    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051098    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051101    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051104    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051108    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051111    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051114    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051117    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051119    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051123    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051126    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:33.053656 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051129    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051132    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051134    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051137    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051158    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051164    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051167    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051169    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051172    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051175    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051177    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051180    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051182    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051185    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051187    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051190    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051192    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051195    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051197    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051200    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:33.054167 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051202    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051205    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051207    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051211    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051214    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051217    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051222    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051225    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051228    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051230    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051233    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051235    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051238    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051240    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051243    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051246    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051249    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051252    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051254    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:33.054653 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051257    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051259    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051262    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051264    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051267    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051270    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051272    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051274    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051277    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051279    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051282    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051284    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051287    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051289    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051292    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051294    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051297    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051299    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051302    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051305    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:33.055107 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051308    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051311    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051313    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051316    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.051321    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051431    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051436    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051439    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051442    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051445    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051448    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051451    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051454    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051457    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051459    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:33.055632 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051462    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051465    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051468    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051471    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051474    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051476    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051479    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051481    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051484    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051486    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051489    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051491    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051494    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051496    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051499    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051502    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051505    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051507    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051510    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051512    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:33.055999 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051515    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051517    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051520    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051522    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051525    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051527    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051530    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051532    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051534    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051537    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051539    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051542    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051545    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051547    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051550    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051552    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051555    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051557    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051560    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051562    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:33.056506 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051564    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051567    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051569    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051572    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051574    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051577    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051579    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051582    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051585    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051587    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051590    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051593    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051596    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051598    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051601    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051603    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051606    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051608    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051611    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:33.056987 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051613    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051615    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051618    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051620    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051623    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051625    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051627    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051630    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051632    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051635    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051637    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051640    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051643    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051645    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051647    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051650    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051654    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051657    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051661    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:33.057511 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051664    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051667    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051670    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051673    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051676    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051678    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051681    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051684    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051687    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051689    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:33.051693    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.051697    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.051811    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.053770    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:57:33.057983 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.055033    2579 server.go:1019] "Starting client certificate rotation"
Jul 27 20:57:33.058351 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.055138    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:57:33.058351 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.055210    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:57:33.058351 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.057476    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:57:33.061400 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.061383    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:57:33.070907 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.070887    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:57:33.073210 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.073193    2579 log.go:25] "Validated CRI v1 image API"
Jul 27 20:57:33.074048 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.074028    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:57:33.081432 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.081412    2579 fs.go:135] Filesystem UUIDs: map[34d72383-0f37-4c68-b31d-14ed78f4e5db:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c8405c13-575c-44d9-ae7a-cf1509d2ed38:/dev/nvme0n1p3]
Jul 27 20:57:33.081515 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.081431    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:57:33.086551 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.086529    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:57:33.087637 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.087525    2579 manager.go:216] Machine: {Timestamp:2026-07-27 20:57:33.086086368 +0000 UTC m=+0.346931276 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099794 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ddc358f8c11a58a0baa62f6127da0 SystemUUID:ec2ddc35-8f8c-11a5-8a0b-aa62f6127da0 BootID:7835a760-6fa7-4165-8f93-75af0a996ad2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:de:27:bf:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:de:27:bf:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:1f:6a:71:f5:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:57:33.087637 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.087637    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:57:33.087769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.087757    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:57:33.089676 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.089652    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:57:33.089823 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.089682    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:57:33.090438 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.090426    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:57:33.090474 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.090441    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:57:33.090474 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.090449    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:57:33.091230 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.091220    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:57:33.092050 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.092040    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:57:33.094228 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094217    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:57:33.094342 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094333    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:57:33.094377 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094364    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:57:33.094377 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094374    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:57:33.094431 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094388    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:57:33.094431 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094397    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:57:33.094431 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094407    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:57:33.094777 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094765    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:57:33.094841 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.094783    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:57:33.097677 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.097655    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:57:33.099813 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.099800    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:57:33.099868 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.099831    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:57:33.101481 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101464    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:57:33.101519 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101495    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:57:33.101519 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101506    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:57:33.101519 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101516    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:57:33.101593 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101535    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:57:33.101593 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101545    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:57:33.101593 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101557    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:57:33.101593 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101566    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:57:33.101593 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101577    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:57:33.101593 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101592    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:57:33.101767 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101604    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:57:33.101767 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.101611    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:57:33.102410 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.102396    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:57:33.102445 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.102414    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:57:33.105912 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.105897    2579 server.go:1268] "Started kubelet"
Jul 27 20:57:33.106031 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.105982    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:57:33.106098 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.106071    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:57:33.106239 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.105999    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:57:33.106783 ip-10-0-143-7 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:57:33.112205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.110193    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:57:33.112205 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.110221    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:57:33.112205 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.110133    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:57:33.112205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.110893    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:57:33.112990 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.112316    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:57:33.113695 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.113675    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:57:33.117266 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.116195    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-7.ec2.internal.18c641133868bf2c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-7.ec2.internal,UID:ip-10-0-143-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-7.ec2.internal,},FirstTimestamp:2026-07-27 20:57:33.105553196 +0000 UTC m=+0.366398090,LastTimestamp:2026-07-27 20:57:33.105553196 +0000 UTC m=+0.366398090,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-7.ec2.internal,}"
Jul 27 20:57:33.119831 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.119815    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:57:33.119908 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.119845    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:57:33.119958 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.119909    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.120645 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.120612    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:57:33.120645 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.120612    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:57:33.120645 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.120637    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:57:33.120790 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.120771    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:57:33.120790 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.120780    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:57:33.121004 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.120988    2579 factory.go:55] Registering systemd factory
Jul 27 20:57:33.121060 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.121007    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:57:33.122119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.122100    2579 factory.go:153] Registering CRI-O factory
Jul 27 20:57:33.122119 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.122120    2579 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:57:33.122282 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.122178    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:57:33.122282 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.122199    2579 factory.go:103] Registering Raw factory
Jul 27 20:57:33.122282 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.122209    2579 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:57:33.122633 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.122617    2579 manager.go:349] Starting recovery of all containers
Jul 27 20:57:33.131064 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.131033    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:57:33.131239 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.131188    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:57:33.131665 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.131648    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppbs8"
Jul 27 20:57:33.133091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.133075    2579 manager.go:354] Recovery completed
Jul 27 20:57:33.137226 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.137211    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:33.138093 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.138077    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppbs8"
Jul 27 20:57:33.139461 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.139443    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:33.139541 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.139474    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:33.139541 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.139487    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:33.140052 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.140024    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:57:33.140052 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.140034    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:33.140052 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.140040    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:57:33.140202 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.140059    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:57:33.140734 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.140714    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:33.140784 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.140761    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:33.140784 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.140772    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:33.141861 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.141848    2579 policy_none.go:49] "None policy: Start"
Jul 27 20:57:33.141926 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.141865    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:57:33.141926 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.141875    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:57:33.143027 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.143015    2579 policy_none.go:47] "Start"
Jul 27 20:57:33.180727 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.180711    2579 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:57:33.180805 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.180744    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:57:33.180805 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.180754    2579 server.go:87] "Starting device plugin registration server"
Jul 27 20:57:33.180997 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.180982    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:57:33.181114 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.180997    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:57:33.181114 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.181091    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:57:33.181230 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.181214    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:57:33.181230 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.181224    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:57:33.181718 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.181698    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:57:33.181807 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.181747    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.280991 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.280944    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:57:33.282253 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.281097    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:33.282253 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.282131    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:33.282253 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.282185    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:33.282253 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.282201    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:33.282253 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.282238    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.282514 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.282284    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:57:33.282514 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.282319    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:57:33.282514 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.282344    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:57:33.282514 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.282385    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:57:33.284965 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.284898    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:33.290644 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.290628    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.290726 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.290652    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-7.ec2.internal\": node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.321250 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.321234    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.382817 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.382792    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"]
Jul 27 20:57:33.382914 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.382865    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:33.384262 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.384239    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:33.384362 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.384272    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:33.384362 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.384287    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:33.386093 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386078    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:33.386250 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.386304 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386268    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:33.386752 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386737    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:33.386827 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386760    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:33.386827 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386770    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:33.386827 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386803    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:33.386827 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386822    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:33.386950 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.386834    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:33.388136 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.388119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.388233 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.388166    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:33.388846 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.388830    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:33.388891 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.388857    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:33.388891 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.388873    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:33.421487 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.421463    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.421553 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.421523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c627c77d7235f38b874acef751ba8ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"0c627c77d7235f38b874acef751ba8ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.421598 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.421568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e96ac081a13f35be7d7732312e8932bb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.ec2.internal\" (UID: \"e96ac081a13f35be7d7732312e8932bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.421641 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.421595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c627c77d7235f38b874acef751ba8ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"0c627c77d7235f38b874acef751ba8ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.422942 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.422930    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-7.ec2.internal\" not found" node="ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.427497 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.427483    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-7.ec2.internal\" not found" node="ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.521885 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.521853    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.521989 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.521909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c627c77d7235f38b874acef751ba8ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"0c627c77d7235f38b874acef751ba8ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.521989 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.521934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c627c77d7235f38b874acef751ba8ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"0c627c77d7235f38b874acef751ba8ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.521989 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.521953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e96ac081a13f35be7d7732312e8932bb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.ec2.internal\" (UID: \"e96ac081a13f35be7d7732312e8932bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.522099 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.521994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e96ac081a13f35be7d7732312e8932bb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.ec2.internal\" (UID: \"e96ac081a13f35be7d7732312e8932bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.522099 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.522014    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c627c77d7235f38b874acef751ba8ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"0c627c77d7235f38b874acef751ba8ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.522099 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.522029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c627c77d7235f38b874acef751ba8ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"0c627c77d7235f38b874acef751ba8ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.622560 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.622510    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.722937 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:33.722902    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:33.726102 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.726077    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:33.731135 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:33.731122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:34.923789 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:34.923623    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:35.024135 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.024058    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 27 20:57:35.083858 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.083830    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:35.107646 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.107621    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:35.120657 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.120631    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:35.132299 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.132282    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:57:35.134504 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.134492    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 27 20:57:35.142283 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.142270    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:57:35.155417 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.155402    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:57:35.155537 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.155517    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:57:35.155582 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.155555    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:57:35.155582 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.155557    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:57:35.195754 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.195733    2579 apiserver.go:52] "Watching apiserver"
Jul 27 20:57:35.214859 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.214831    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:57:35.215259 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.215231    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4vsdl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f","openshift-cluster-node-tuning-operator/tuned-6lfwr","openshift-dns/node-resolver-jfjn2","openshift-multus/multus-p6xmj","openshift-network-operator/iptables-alerter-k8vz2","openshift-ovn-kubernetes/ovnkube-node-59htb","kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal","openshift-image-registry/node-ca-wrjxn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal","openshift-multus/multus-additional-cni-plugins-dh4n9","openshift-multus/network-metrics-daemon-6j54f","openshift-network-diagnostics/network-check-target-99n8c","kube-system/global-pull-secret-syncer-g6r5w"]
Jul 27 20:57:35.217101 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.217085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.218674 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.218657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:35.218757 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.218712    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:35.219257 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.219237    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:57:35.219568 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.219547    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:57:35.219707 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.219622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:57:35.219770 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.219755    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:57:35.219815 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.219774    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:57:35.219863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.219776    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:57:35.219927 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.219782    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkcn5\""
Jul 27 20:57:35.220185 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.220173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.220394 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.220377    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:57:35.221389 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.221370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.221980 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.221963    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:57:35.222234 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.222219    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:57:35.222377 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.222363    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f7jsp\""
Jul 27 20:57:35.223043 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.223028    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.223470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.223455    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:57:35.223554 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.223468    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:57:35.223554 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.223488    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g4dd7\""
Jul 27 20:57:35.224377 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224357    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.224747 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-systemd\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.224863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.224863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-ovn\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.224863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-log-socket\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.224863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysctl-conf\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.224863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-sys\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.224863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-tmp-dir\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.224863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-kubelet\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-node-log\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-systemd-units\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.224984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-cni-netd\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-ovnkube-config\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-env-overrides\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysctl-d\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac276ab2-074b-4048-a8cb-afff389526a5-tmp\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225131    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j6nrj\""
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225162    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-lib-modules\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-var-lib-kubelet\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225176    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:57:35.225219 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-hosts-file\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-cni-bin\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qfhm\" (UniqueName: \"kubernetes.io/projected/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-kube-api-access-5qfhm\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-etc-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-run-ovn-kubernetes\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-ovnkube-script-lib\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-kubernetes\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-systemd\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-run\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225477    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-run-netns\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-var-lib-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/105298c2-257c-4fdf-8ccf-63710d64d503-ovn-node-metrics-cert\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-modprobe-d\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-host\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac276ab2-074b-4048-a8cb-afff389526a5-etc-tuned\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.225786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-slash\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.226527 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.226527 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvlb\" (UniqueName: \"kubernetes.io/projected/105298c2-257c-4fdf-8ccf-63710d64d503-kube-api-access-8pvlb\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.226527 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:35.226527 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysconfig\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.226527 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.226527 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.225797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qvk\" (UniqueName: \"kubernetes.io/projected/ac276ab2-074b-4048-a8cb-afff389526a5-kube-api-access-z9qvk\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.226527 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.226470    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:57:35.226863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.226536    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:57:35.226863 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.226618    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:57:35.227001 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.226983    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xnc99\""
Jul 27 20:57:35.227257 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.227231    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.227928 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.227913    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:57:35.228901 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.228881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:57:35.228995 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.228956    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rv7sd\""
Jul 27 20:57:35.229147 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.229126    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:57:35.230587 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.229910    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:57:35.230587 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.230051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:57:35.230587 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.230500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.230825 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.230806    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tlv5l\""
Jul 27 20:57:35.232140 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.232126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.232337 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.232314    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:35.234225 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.234203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.235043 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.235025    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:57:35.235205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.235194    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:57:35.235329 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.235315    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:57:35.235567 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.235551    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9cjdn\""
Jul 27 20:57:35.235708 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.235695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:35.235769 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.235754    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:35.236127 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.236114    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:57:35.236280 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.236266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2jnv\""
Jul 27 20:57:35.236348 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.236334    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:57:35.236892 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.236876    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:57:35.243184 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.243147    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:52:34 +0000 UTC" deadline="2027-12-23 03:51:24.79130079 +0000 UTC"
Jul 27 20:57:35.243184 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.243180    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12318h53m49.54812328s"
Jul 27 20:57:35.259865 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.259848    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x772b"
Jul 27 20:57:35.268112 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.268095    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x772b"
Jul 27 20:57:35.300019 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.299990    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96ac081a13f35be7d7732312e8932bb.slice/crio-a2444e7deec0509add16433c0208fce780e02ad669563f5498667f16c047426f WatchSource:0}: Error finding container a2444e7deec0509add16433c0208fce780e02ad669563f5498667f16c047426f: Status 404 returned error can't find the container with id a2444e7deec0509add16433c0208fce780e02ad669563f5498667f16c047426f
Jul 27 20:57:35.304765 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.304741    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:57:35.321861 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.321844    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:57:35.326710 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-run-netns\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.326794 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-cni-multus\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.326794 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4eedc323-ed18-4caa-a678-cd72443230bb-konnectivity-ca\") pod \"konnectivity-agent-4vsdl\" (UID: \"4eedc323-ed18-4caa-a678-cd72443230bb\") " pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.326794 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznwb\" (UniqueName: \"kubernetes.io/projected/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-kube-api-access-rznwb\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.326912 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-slash\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.326912 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-run-netns\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.326912 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-slash\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.326912 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.326912 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvlb\" (UniqueName: \"kubernetes.io/projected/105298c2-257c-4fdf-8ccf-63710d64d503-kube-api-access-8pvlb\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:35.327091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.326964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysconfig\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.327256 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysconfig\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.327318 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qvk\" (UniqueName: \"kubernetes.io/projected/ac276ab2-074b-4048-a8cb-afff389526a5-kube-api-access-z9qvk\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.327318 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4eedc323-ed18-4caa-a678-cd72443230bb-agent-certs\") pod \"konnectivity-agent-4vsdl\" (UID: \"4eedc323-ed18-4caa-a678-cd72443230bb\") " pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.327415 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-device-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.327415 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-systemd\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327415 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327573 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-log-socket\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327573 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-systemd\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327573 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-log-socket\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327573 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-sys\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.327573 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-sys\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.327786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327564    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgjss\" (UniqueName: \"kubernetes.io/projected/e9bbfe05-3cd1-4254-98de-d3e94042dd83-kube-api-access-mgjss\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.327786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.327786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.327786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.327786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-kubelet\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.327786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-netns\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-os-release\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-host-slash\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw9b6\" (UniqueName: \"kubernetes.io/projected/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-kube-api-access-gw9b6\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-kubelet\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t82n\" (UniqueName: \"kubernetes.io/projected/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-kube-api-access-6t82n\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-systemd-units\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-ovnkube-config\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysctl-d\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-k8s-cni-cncf-io\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.327988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-systemd-units\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9bbfe05-3cd1-4254-98de-d3e94042dd83-serviceca\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-sys-fs\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-cnibin\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.328205 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-cni-bin\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-cni-binary-copy\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysctl-d\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-kubelet\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-conf-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-cni-bin\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qfhm\" (UniqueName: \"kubernetes.io/projected/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-kube-api-access-5qfhm\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-etc-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-run-ovn-kubernetes\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-kubernetes\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-etc-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-systemd\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-run-ovn-kubernetes\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-run\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-systemd\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-kubernetes\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.328850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-cni-bin\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-var-lib-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/105298c2-257c-4fdf-8ccf-63710d64d503-ovn-node-metrics-cert\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-modprobe-d\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-var-lib-openvswitch\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-host\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328899    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-run\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-socket-dir-parent\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-etc-kubernetes\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-modprobe-d\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-cnibin\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-host\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.328997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-iptables-alerter-script\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-cni-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-ovnkube-config\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:35.329470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-ovn\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysctl-conf\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqmj\" (UniqueName: \"kubernetes.io/projected/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-kube-api-access-pwqmj\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-run-ovn\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-tmp-dir\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-node-log\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-system-cni-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-etc-sysctl-conf\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6g6\" (UniqueName: \"kubernetes.io/projected/de6f1fc5-b897-4ea8-9534-c388a45937d1-kube-api-access-7t6g6\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329330    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-node-log\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-cni-netd\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-env-overrides\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac276ab2-074b-4048-a8cb-afff389526a5-tmp\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/105298c2-257c-4fdf-8ccf-63710d64d503-host-cni-netd\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-hostroot\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-tmp-dir\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.330227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-system-cni-dir\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-registration-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-lib-modules\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-var-lib-kubelet\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-daemon-config\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9bbfe05-3cd1-4254-98de-d3e94042dd83-host\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-hosts-file\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-var-lib-kubelet\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-os-release\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329876    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-env-overrides\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-multus-certs\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-hosts-file\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fc4a764-fc39-467f-8bcd-cd0306e92175-kubelet-config\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.329996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-socket-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.330016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-ovnkube-script-lib\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.330063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac276ab2-074b-4048-a8cb-afff389526a5-etc-tuned\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.330163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fc4a764-fc39-467f-8bcd-cd0306e92175-dbus\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.330952 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.330323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac276ab2-074b-4048-a8cb-afff389526a5-lib-modules\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.331443 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.330647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/105298c2-257c-4fdf-8ccf-63710d64d503-ovnkube-script-lib\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.332734 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.332717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac276ab2-074b-4048-a8cb-afff389526a5-tmp\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.332807 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.332792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac276ab2-074b-4048-a8cb-afff389526a5-etc-tuned\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.332852 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.332838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/105298c2-257c-4fdf-8ccf-63710d64d503-ovn-node-metrics-cert\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.338347 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.338328    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:35.338347 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.338348    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:35.338456 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.338359    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jt2f7 for pod openshift-network-diagnostics/network-check-target-99n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:35.338456 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.338443    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7 podName:efe374c0-ac88-4374-8fff-244ed6bc8789 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:35.83842085 +0000 UTC m=+1.998811208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jt2f7" (UniqueName: "kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7") pod "network-check-target-99n8c" (UID: "efe374c0-ac88-4374-8fff-244ed6bc8789") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:35.342048 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.342025    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qfhm\" (UniqueName: \"kubernetes.io/projected/f855d0ec-cba7-4c2a-9986-5c5bee38a5e8-kube-api-access-5qfhm\") pod \"node-resolver-jfjn2\" (UID: \"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8\") " pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.342048 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.342037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qvk\" (UniqueName: \"kubernetes.io/projected/ac276ab2-074b-4048-a8cb-afff389526a5-kube-api-access-z9qvk\") pod \"tuned-6lfwr\" (UID: \"ac276ab2-074b-4048-a8cb-afff389526a5\") " pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.342176 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.342102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvlb\" (UniqueName: \"kubernetes.io/projected/105298c2-257c-4fdf-8ccf-63710d64d503-kube-api-access-8pvlb\") pod \"ovnkube-node-59htb\" (UID: \"105298c2-257c-4fdf-8ccf-63710d64d503\") " pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.346010 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.345989    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c627c77d7235f38b874acef751ba8ac.slice/crio-0dc51bd9e22fafba65136f19faec5b516a83cbe476923b9080fd5bff5fcded25 WatchSource:0}: Error finding container 0dc51bd9e22fafba65136f19faec5b516a83cbe476923b9080fd5bff5fcded25: Status 404 returned error can't find the container with id 0dc51bd9e22fafba65136f19faec5b516a83cbe476923b9080fd5bff5fcded25
Jul 27 20:57:35.386230 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.386180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" event={"ID":"0c627c77d7235f38b874acef751ba8ac","Type":"ContainerStarted","Data":"0dc51bd9e22fafba65136f19faec5b516a83cbe476923b9080fd5bff5fcded25"}
Jul 27 20:57:35.387181 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.387157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal" event={"ID":"e96ac081a13f35be7d7732312e8932bb","Type":"ContainerStarted","Data":"a2444e7deec0509add16433c0208fce780e02ad669563f5498667f16c047426f"}
Jul 27 20:57:35.430452 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6g6\" (UniqueName: \"kubernetes.io/projected/de6f1fc5-b897-4ea8-9534-c388a45937d1-kube-api-access-7t6g6\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.430575 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-hostroot\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.430575 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-system-cni-dir\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.430575 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-system-cni-dir\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.430780 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430568    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-hostroot\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.430780 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-registration-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.430780 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-daemon-config\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.430780 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9bbfe05-3cd1-4254-98de-d3e94042dd83-host\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.430780 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-registration-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.430780 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-os-release\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.430780 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-multus-certs\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fc4a764-fc39-467f-8bcd-cd0306e92175-kubelet-config\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-os-release\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9bbfe05-3cd1-4254-98de-d3e94042dd83-host\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-socket-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-multus-certs\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fc4a764-fc39-467f-8bcd-cd0306e92175-dbus\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fc4a764-fc39-467f-8bcd-cd0306e92175-kubelet-config\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-cni-multus\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4eedc323-ed18-4caa-a678-cd72443230bb-konnectivity-ca\") pod \"konnectivity-agent-4vsdl\" (UID: \"4eedc323-ed18-4caa-a678-cd72443230bb\") " pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-cni-multus\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430965    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-socket-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.430971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznwb\" (UniqueName: \"kubernetes.io/projected/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-kube-api-access-rznwb\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4eedc323-ed18-4caa-a678-cd72443230bb-agent-certs\") pod \"konnectivity-agent-4vsdl\" (UID: \"4eedc323-ed18-4caa-a678-cd72443230bb\") " pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-device-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fc4a764-fc39-467f-8bcd-cd0306e92175-dbus\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgjss\" (UniqueName: \"kubernetes.io/projected/e9bbfe05-3cd1-4254-98de-d3e94042dd83-kube-api-access-mgjss\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.431091 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-device-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431276    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-daemon-config\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-netns\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-os-release\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-netns\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-host-slash\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-host-slash\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw9b6\" (UniqueName: \"kubernetes.io/projected/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-kube-api-access-gw9b6\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t82n\" (UniqueName: \"kubernetes.io/projected/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-kube-api-access-6t82n\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-os-release\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-k8s-cni-cncf-io\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9bbfe05-3cd1-4254-98de-d3e94042dd83-serviceca\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4eedc323-ed18-4caa-a678-cd72443230bb-konnectivity-ca\") pod \"konnectivity-agent-4vsdl\" (UID: \"4eedc323-ed18-4caa-a678-cd72443230bb\") " pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-sys-fs\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.431849 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-cnibin\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-run-k8s-cni-cncf-io\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431581    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-cnibin\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-sys-fs\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431687    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-cni-binary-copy\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-kubelet\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-conf-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-cni-bin\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9bbfe05-3cd1-4254-98de-d3e94042dd83-serviceca\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-socket-dir-parent\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-kubelet\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-etc-kubernetes\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.431994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-socket-dir-parent\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.432579 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-cnibin\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-iptables-alerter-script\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432033    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-etc-kubernetes\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-conf-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-cni-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.432062    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-cnibin\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-multus-cni-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.432141    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret podName:2fc4a764-fc39-467f-8bcd-cd0306e92175 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:35.932118385 +0000 UTC m=+2.092508739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret") pod "global-pull-secret-syncer-g6r5w" (UID: "2fc4a764-fc39-467f-8bcd-cd0306e92175") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-cni-binary-copy\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.432177    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-host-var-lib-cni-bin\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqmj\" (UniqueName: \"kubernetes.io/projected/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-kube-api-access-pwqmj\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.432275    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:57:35.932259421 +0000 UTC m=+2.092649772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:35.433116 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de6f1fc5-b897-4ea8-9534-c388a45937d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.433584 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.433584 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-system-cni-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433584 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-system-cni-dir\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.433584 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-iptables-alerter-script\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.433584 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.432760    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de6f1fc5-b897-4ea8-9534-c388a45937d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.433948 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.433930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4eedc323-ed18-4caa-a678-cd72443230bb-agent-certs\") pod \"konnectivity-agent-4vsdl\" (UID: \"4eedc323-ed18-4caa-a678-cd72443230bb\") " pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.439136 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.439115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznwb\" (UniqueName: \"kubernetes.io/projected/33ea5bb0-eb79-4cb9-9212-d14e33fc186a-kube-api-access-rznwb\") pod \"iptables-alerter-k8vz2\" (UID: \"33ea5bb0-eb79-4cb9-9212-d14e33fc186a\") " pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.439417 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.439396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw9b6\" (UniqueName: \"kubernetes.io/projected/a4ddb2f1-b95f-4acd-8e54-9be8c509629d-kube-api-access-gw9b6\") pod \"aws-ebs-csi-driver-node-wzs2f\" (UID: \"a4ddb2f1-b95f-4acd-8e54-9be8c509629d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.440021 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.440004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgjss\" (UniqueName: \"kubernetes.io/projected/e9bbfe05-3cd1-4254-98de-d3e94042dd83-kube-api-access-mgjss\") pod \"node-ca-wrjxn\" (UID: \"e9bbfe05-3cd1-4254-98de-d3e94042dd83\") " pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.440224 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.440207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t82n\" (UniqueName: \"kubernetes.io/projected/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-kube-api-access-6t82n\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:35.440414 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.440398    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqmj\" (UniqueName: \"kubernetes.io/projected/c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7-kube-api-access-pwqmj\") pod \"multus-p6xmj\" (UID: \"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7\") " pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.440925 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.440909    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6g6\" (UniqueName: \"kubernetes.io/projected/de6f1fc5-b897-4ea8-9534-c388a45937d1-kube-api-access-7t6g6\") pod \"multus-additional-cni-plugins-dh4n9\" (UID: \"de6f1fc5-b897-4ea8-9534-c388a45937d1\") " pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.544167 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.544096    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:57:35.552617 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.552576    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105298c2_257c_4fdf_8ccf_63710d64d503.slice/crio-b92f38a8fbf2b890c11f254edca3ff440de31293f5f585150dae3d8afe821b1c WatchSource:0}: Error finding container b92f38a8fbf2b890c11f254edca3ff440de31293f5f585150dae3d8afe821b1c: Status 404 returned error can't find the container with id b92f38a8fbf2b890c11f254edca3ff440de31293f5f585150dae3d8afe821b1c
Jul 27 20:57:35.553474 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.553450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6lfwr"
Jul 27 20:57:35.560372 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.560351    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac276ab2_074b_4048_a8cb_afff389526a5.slice/crio-d128e695c8eeb1d3a74f1f922eb181ae6a66d4688bf566538ec37d719af7102c WatchSource:0}: Error finding container d128e695c8eeb1d3a74f1f922eb181ae6a66d4688bf566538ec37d719af7102c: Status 404 returned error can't find the container with id d128e695c8eeb1d3a74f1f922eb181ae6a66d4688bf566538ec37d719af7102c
Jul 27 20:57:35.560890 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.560874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfjn2"
Jul 27 20:57:35.568563 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.568544    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf855d0ec_cba7_4c2a_9986_5c5bee38a5e8.slice/crio-32962b01959b812772320c826aa9694556705b301dd5bff145d889c76f52b368 WatchSource:0}: Error finding container 32962b01959b812772320c826aa9694556705b301dd5bff145d889c76f52b368: Status 404 returned error can't find the container with id 32962b01959b812772320c826aa9694556705b301dd5bff145d889c76f52b368
Jul 27 20:57:35.571554 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.571538    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p6xmj"
Jul 27 20:57:35.578280 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.578261    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2767fa3_8e6d_4382_8fd2_02d4b5a9cfe7.slice/crio-03ed4b253ae0ccae5be86eb58747858e55d162facee83d8238af1ab4ea0d5bf6 WatchSource:0}: Error finding container 03ed4b253ae0ccae5be86eb58747858e55d162facee83d8238af1ab4ea0d5bf6: Status 404 returned error can't find the container with id 03ed4b253ae0ccae5be86eb58747858e55d162facee83d8238af1ab4ea0d5bf6
Jul 27 20:57:35.599323 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.599298    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k8vz2"
Jul 27 20:57:35.606014 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.605992    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ea5bb0_eb79_4cb9_9212_d14e33fc186a.slice/crio-62428c9ced668fb108493bada2fefec0c065a8507f804304d21634397334cb7b WatchSource:0}: Error finding container 62428c9ced668fb108493bada2fefec0c065a8507f804304d21634397334cb7b: Status 404 returned error can't find the container with id 62428c9ced668fb108493bada2fefec0c065a8507f804304d21634397334cb7b
Jul 27 20:57:35.607227 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.607214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrjxn"
Jul 27 20:57:35.612440 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.612424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:35.614637 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.614590    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bbfe05_3cd1_4254_98de_d3e94042dd83.slice/crio-d41724b3448b2c2eb473d7b10817345c77b580f43c1cd6e4b9b0f3b15b2cac00 WatchSource:0}: Error finding container d41724b3448b2c2eb473d7b10817345c77b580f43c1cd6e4b9b0f3b15b2cac00: Status 404 returned error can't find the container with id d41724b3448b2c2eb473d7b10817345c77b580f43c1cd6e4b9b0f3b15b2cac00
Jul 27 20:57:35.618046 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.618027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f"
Jul 27 20:57:35.621921 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.621901    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eedc323_ed18_4caa_a678_cd72443230bb.slice/crio-4bc528e0b042c5dd247abda905a5c0ff78424aa117ae6669265d050411cfa4d1 WatchSource:0}: Error finding container 4bc528e0b042c5dd247abda905a5c0ff78424aa117ae6669265d050411cfa4d1: Status 404 returned error can't find the container with id 4bc528e0b042c5dd247abda905a5c0ff78424aa117ae6669265d050411cfa4d1
Jul 27 20:57:35.623783 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.623759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dh4n9"
Jul 27 20:57:35.625937 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.625839    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ddb2f1_b95f_4acd_8e54_9be8c509629d.slice/crio-9ba2b01a6fff2328c98b526f65a9d990ab882fa7b15e62619fb11ef4cd1c77be WatchSource:0}: Error finding container 9ba2b01a6fff2328c98b526f65a9d990ab882fa7b15e62619fb11ef4cd1c77be: Status 404 returned error can't find the container with id 9ba2b01a6fff2328c98b526f65a9d990ab882fa7b15e62619fb11ef4cd1c77be
Jul 27 20:57:35.631171 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:57:35.631152    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6f1fc5_b897_4ea8_9534_c388a45937d1.slice/crio-99e7300bf1afe5ccff165044549d97c31a720dfd257185680f7b546616bab8ee WatchSource:0}: Error finding container 99e7300bf1afe5ccff165044549d97c31a720dfd257185680f7b546616bab8ee: Status 404 returned error can't find the container with id 99e7300bf1afe5ccff165044549d97c31a720dfd257185680f7b546616bab8ee
Jul 27 20:57:35.820702 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.819412    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:35.934742 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.934702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:35.934906 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.934758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:35.934906 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:35.934809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:35.934906 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.934879    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:35.935063 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.934929    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:35.935063 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.934930    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:35.935063 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.934948    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:35.935063 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.934958    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret podName:2fc4a764-fc39-467f-8bcd-cd0306e92175 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:36.934937865 +0000 UTC m=+3.095328221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret") pod "global-pull-secret-syncer-g6r5w" (UID: "2fc4a764-fc39-467f-8bcd-cd0306e92175") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:35.935063 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.934961    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jt2f7 for pod openshift-network-diagnostics/network-check-target-99n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:35.935063 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.934995    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:57:36.934976145 +0000 UTC m=+3.095366496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:35.935063 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:35.935018    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7 podName:efe374c0-ac88-4374-8fff-244ed6bc8789 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:36.935005859 +0000 UTC m=+3.095396206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt2f7" (UniqueName: "kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7") pod "network-check-target-99n8c" (UID: "efe374c0-ac88-4374-8fff-244ed6bc8789") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:36.270684 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.270555    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:52:35 +0000 UTC" deadline="2028-02-15 07:24:57.171585811 +0000 UTC"
Jul 27 20:57:36.270684 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.270636    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13618h27m20.900954637s"
Jul 27 20:57:36.383757 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.383724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:36.383987 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.383894    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:36.383987 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.383943    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:36.384105 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.384056    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:36.415130 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.415093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4vsdl" event={"ID":"4eedc323-ed18-4caa-a678-cd72443230bb","Type":"ContainerStarted","Data":"4bc528e0b042c5dd247abda905a5c0ff78424aa117ae6669265d050411cfa4d1"}
Jul 27 20:57:36.434818 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.434741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k8vz2" event={"ID":"33ea5bb0-eb79-4cb9-9212-d14e33fc186a","Type":"ContainerStarted","Data":"62428c9ced668fb108493bada2fefec0c065a8507f804304d21634397334cb7b"}
Jul 27 20:57:36.444846 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.444810    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p6xmj" event={"ID":"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7","Type":"ContainerStarted","Data":"03ed4b253ae0ccae5be86eb58747858e55d162facee83d8238af1ab4ea0d5bf6"}
Jul 27 20:57:36.463620 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.463572    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6lfwr" event={"ID":"ac276ab2-074b-4048-a8cb-afff389526a5","Type":"ContainerStarted","Data":"d128e695c8eeb1d3a74f1f922eb181ae6a66d4688bf566538ec37d719af7102c"}
Jul 27 20:57:36.475355 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.475321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerStarted","Data":"99e7300bf1afe5ccff165044549d97c31a720dfd257185680f7b546616bab8ee"}
Jul 27 20:57:36.496647 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.496613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f" event={"ID":"a4ddb2f1-b95f-4acd-8e54-9be8c509629d","Type":"ContainerStarted","Data":"9ba2b01a6fff2328c98b526f65a9d990ab882fa7b15e62619fb11ef4cd1c77be"}
Jul 27 20:57:36.509297 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.509159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrjxn" event={"ID":"e9bbfe05-3cd1-4254-98de-d3e94042dd83","Type":"ContainerStarted","Data":"d41724b3448b2c2eb473d7b10817345c77b580f43c1cd6e4b9b0f3b15b2cac00"}
Jul 27 20:57:36.525846 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.525767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfjn2" event={"ID":"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8","Type":"ContainerStarted","Data":"32962b01959b812772320c826aa9694556705b301dd5bff145d889c76f52b368"}
Jul 27 20:57:36.542738 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.542703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"b92f38a8fbf2b890c11f254edca3ff440de31293f5f585150dae3d8afe821b1c"}
Jul 27 20:57:36.704850 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.704737    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:36.816938 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.816830    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:36.947738 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.947391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:36.947738 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.947457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:36.947738 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.947497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:36.947738 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.947651    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:36.947738 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.947714    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:57:38.947696064 +0000 UTC m=+5.108086408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:36.948141 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.948116    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:36.948141 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.948136    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:36.948242 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.948150    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jt2f7 for pod openshift-network-diagnostics/network-check-target-99n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:36.948242 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.948203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7 podName:efe374c0-ac88-4374-8fff-244ed6bc8789 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:38.9481869 +0000 UTC m=+5.108577259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt2f7" (UniqueName: "kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7") pod "network-check-target-99n8c" (UID: "efe374c0-ac88-4374-8fff-244ed6bc8789") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:36.948351 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.948278    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:36.948351 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:36.948313    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret podName:2fc4a764-fc39-467f-8bcd-cd0306e92175 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:38.948301333 +0000 UTC m=+5.108691671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret") pod "global-pull-secret-syncer-g6r5w" (UID: "2fc4a764-fc39-467f-8bcd-cd0306e92175") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:36.979467 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:36.979434    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:37.271701 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:37.271592    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:52:35 +0000 UTC" deadline="2028-03-16 10:46:19.067560126 +0000 UTC"
Jul 27 20:57:37.271701 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:37.271645    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14341h48m41.79592082s"
Jul 27 20:57:37.383063 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:37.383020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:37.383251 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:37.383176    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:38.395399 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:38.393564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:38.395399 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.393697    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:38.395399 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:38.393779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:38.395399 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.393895    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:38.964644 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:38.964583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:38.964828 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:38.964684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:38.964828 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.964721    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:38.964828 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:38.964745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:38.964828 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.964787    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret podName:2fc4a764-fc39-467f-8bcd-cd0306e92175 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:42.964768532 +0000 UTC m=+9.125158880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret") pod "global-pull-secret-syncer-g6r5w" (UID: "2fc4a764-fc39-467f-8bcd-cd0306e92175") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:38.965034 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.964868    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:38.965034 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.964890    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:38.965034 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.964902    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jt2f7 for pod openshift-network-diagnostics/network-check-target-99n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:38.965167 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.965115    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7 podName:efe374c0-ac88-4374-8fff-244ed6bc8789 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:42.965095439 +0000 UTC m=+9.125485797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt2f7" (UniqueName: "kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7") pod "network-check-target-99n8c" (UID: "efe374c0-ac88-4374-8fff-244ed6bc8789") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:38.965167 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.965150    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:38.965259 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:38.965199    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:57:42.965183127 +0000 UTC m=+9.125573478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:39.383716 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:39.383139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:39.383716 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:39.383285    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:40.383481 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:40.383435    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:40.383959 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:40.383576    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:40.384138 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:40.384118    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:40.384229 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:40.384211    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:41.383824 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:41.383789    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:41.384247 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:41.383989    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:42.385673 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:42.383948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:42.385673 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:42.383969    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:42.385673 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:42.384080    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:42.385673 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:42.384510    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:43.000836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:43.000903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:43.000943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001086    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001147    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:57:51.001128913 +0000 UTC m=+17.161519265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001576    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001594    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001629    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jt2f7 for pod openshift-network-diagnostics/network-check-target-99n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001675    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7 podName:efe374c0-ac88-4374-8fff-244ed6bc8789 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:51.001660617 +0000 UTC m=+17.162050969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt2f7" (UniqueName: "kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7") pod "network-check-target-99n8c" (UID: "efe374c0-ac88-4374-8fff-244ed6bc8789") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001738    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:43.001874 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.001837    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret podName:2fc4a764-fc39-467f-8bcd-cd0306e92175 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:51.001825872 +0000 UTC m=+17.162216223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret") pod "global-pull-secret-syncer-g6r5w" (UID: "2fc4a764-fc39-467f-8bcd-cd0306e92175") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:43.383674 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:43.383581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:43.383844 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:43.383746    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:44.385589 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:44.384383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:44.385589 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:44.384497    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:44.385589 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:44.384908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:44.385589 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:44.384996    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:45.384309 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:45.383822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:45.384309 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:45.383967    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:46.384772 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:46.384697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:46.385359 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:46.385322    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:46.385729 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:46.385710    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:46.385829 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:46.385803    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:47.383695 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:47.383614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:47.383877 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:47.383779    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:48.383451 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:48.383411    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:48.383451 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:48.383434    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:48.383926 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:48.383555    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:48.383926 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:48.383700    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:49.383356 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:49.383322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:49.383571 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:49.383471    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:50.384112 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:50.384081    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:50.384537 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:50.384207    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:50.384679 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:50.384543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:50.384679 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:50.384638    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:51.066034 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:51.065993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:51.066214 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:51.066042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:51.066214 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:51.066093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:51.066214 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066196    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:51.066214 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066213    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:51.066357 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066218    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:51.066357 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066233    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jt2f7 for pod openshift-network-diagnostics/network-check-target-99n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:51.066357 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066237    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:51.066357 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066272    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:58:07.066257497 +0000 UTC m=+33.226647834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:51.066357 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066299    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret podName:2fc4a764-fc39-467f-8bcd-cd0306e92175 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:07.066279605 +0000 UTC m=+33.226669945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret") pod "global-pull-secret-syncer-g6r5w" (UID: "2fc4a764-fc39-467f-8bcd-cd0306e92175") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:51.066357 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.066319    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7 podName:efe374c0-ac88-4374-8fff-244ed6bc8789 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:07.066309091 +0000 UTC m=+33.226699431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt2f7" (UniqueName: "kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7") pod "network-check-target-99n8c" (UID: "efe374c0-ac88-4374-8fff-244ed6bc8789") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:51.383851 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:51.383779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:51.383999 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:51.383902    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:52.383735 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:52.383699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:52.384209 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:52.383699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:52.384209 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:52.383836    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:52.384209 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:52.383914    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:53.383533 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:53.383498    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:53.383742 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:53.383645    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:54.384028 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:54.383992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:54.384485 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:54.384106    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:54.384485 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:54.384149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:54.384485 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:54.384234    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:55.383331 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:55.383308    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:55.383432 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:55.383414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:56.383278 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.383121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:56.383917 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.383185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:56.383917 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:56.383379    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:56.383917 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:56.383426    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:56.591312 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.591275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"1047ba18d652ddaa067324ab553113830ec6320f2f5dedcd72636230f1d0a25e"}
Jul 27 20:57:56.591478 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.591397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"0946170054d9f21a85dae49eba712ed95195e9151e769eecbfca97cd595ae8f8"}
Jul 27 20:57:56.591478 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.591470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"d4fbe8c73673a67286bbdd48b2ec12fca859725cdaefda0de145363697b2d3d9"}
Jul 27 20:57:56.591638 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.591520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"78ddc758b23c2f54b0e7b0e00fdbf281d104aca77e1770bc582e3398d6a50f9f"}
Jul 27 20:57:56.591638 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.591568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"8eebd374391e4077b8be2b6d58e8b15d2c4488dbd9fe93ab69615982b2ccb760"}
Jul 27 20:57:56.591751 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.591645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"13dd898f0d91b8c90fca755a658eb558931ded0407e7b2b6b6bc1e9de3bc7d91"}
Jul 27 20:57:56.592996 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.592941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal" event={"ID":"e96ac081a13f35be7d7732312e8932bb","Type":"ContainerStarted","Data":"89c002afba8aa64ce4290e50ff2a973737aa31c57bebe8e6b565e5e83a0a86ff"}
Jul 27 20:57:56.594473 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.594445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4vsdl" event={"ID":"4eedc323-ed18-4caa-a678-cd72443230bb","Type":"ContainerStarted","Data":"7ec992e3048395bd569f0d82d17525b72e442acb33a7d80469e3334a629714e3"}
Jul 27 20:57:56.595996 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.595968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p6xmj" event={"ID":"c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7","Type":"ContainerStarted","Data":"35fb495827556477a460438c4fc7c8155842ff316ce2e959f6e631a037813533"}
Jul 27 20:57:56.597594 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.597569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6lfwr" event={"ID":"ac276ab2-074b-4048-a8cb-afff389526a5","Type":"ContainerStarted","Data":"55b7de7aaea20c6cefe8fa36a6513312e280d7c0b753471eaf11ea3c3c7c025c"}
Jul 27 20:57:56.599171 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.599140    2579 generic.go:356] "Generic (PLEG): container finished" podID="0c627c77d7235f38b874acef751ba8ac" containerID="59ae542e59a000a66ff015a2ea6ace33ef484c7510f78e522239b7a15881f3d4" exitCode=0
Jul 27 20:57:56.599278 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.599186    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" event={"ID":"0c627c77d7235f38b874acef751ba8ac","Type":"ContainerDied","Data":"59ae542e59a000a66ff015a2ea6ace33ef484c7510f78e522239b7a15881f3d4"}
Jul 27 20:57:56.602288 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.602266    2579 generic.go:356] "Generic (PLEG): container finished" podID="de6f1fc5-b897-4ea8-9534-c388a45937d1" containerID="81d47ddb94f5ce2463130a66cabc685680ce0083f98c9b95a7ad9b46f0c2c6c7" exitCode=0
Jul 27 20:57:56.602388 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.602349    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerDied","Data":"81d47ddb94f5ce2463130a66cabc685680ce0083f98c9b95a7ad9b46f0c2c6c7"}
Jul 27 20:57:56.604033 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.604009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f" event={"ID":"a4ddb2f1-b95f-4acd-8e54-9be8c509629d","Type":"ContainerStarted","Data":"1855113042b502ce79d13a7183301e8a0e61699842f44a3c1e87f97573cdfaca"}
Jul 27 20:57:56.606343 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.605745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrjxn" event={"ID":"e9bbfe05-3cd1-4254-98de-d3e94042dd83","Type":"ContainerStarted","Data":"93707fa18567deb63afc86a88c33e8de1684d1f62a058a2a72252534cf76ad23"}
Jul 27 20:57:56.606343 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.606284    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal" podStartSLOduration=21.60626732 podStartE2EDuration="21.60626732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:56.605531507 +0000 UTC m=+22.765921866" watchObservedRunningTime="2026-07-27 20:57:56.60626732 +0000 UTC m=+22.766657679"
Jul 27 20:57:56.607303 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.607284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfjn2" event={"ID":"f855d0ec-cba7-4c2a-9986-5c5bee38a5e8","Type":"ContainerStarted","Data":"6f8a7a3af7bd53d5add234aa7e21ede8bb7c196fb8a44675d22338ea6dee3898"}
Jul 27 20:57:56.634396 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.634345    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6lfwr" podStartSLOduration=2.777536227 podStartE2EDuration="22.63432949s" totalImagesPullingTime="19.856793263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:56.63412695 +0000 UTC m=+22.794517330" watchObservedRunningTime="2026-07-27 20:57:56.63432949 +0000 UTC m=+22.794719848"
Jul 27 20:57:56.650644 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.650579    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p6xmj" podStartSLOduration=2.480466415 podStartE2EDuration="22.650561522s" totalImagesPullingTime="20.170095107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:56.650141289 +0000 UTC m=+22.810531668" watchObservedRunningTime="2026-07-27 20:57:56.650561522 +0000 UTC m=+22.810952077"
Jul 27 20:57:56.671327 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.671287    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4vsdl" podStartSLOduration=2.830456598 podStartE2EDuration="22.671272718s" totalImagesPullingTime="19.84081612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:56.67097111 +0000 UTC m=+22.831361469" watchObservedRunningTime="2026-07-27 20:57:56.671272718 +0000 UTC m=+22.831663076"
Jul 27 20:57:56.715449 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.715293    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wrjxn" podStartSLOduration=2.94466763 podStartE2EDuration="22.715281897s" totalImagesPullingTime="19.770614267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:56.715152748 +0000 UTC m=+22.875543099" watchObservedRunningTime="2026-07-27 20:57:56.715281897 +0000 UTC m=+22.875672253"
Jul 27 20:57:56.731883 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:56.731831    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jfjn2" podStartSLOduration=2.833749695 podStartE2EDuration="22.731811442s" totalImagesPullingTime="19.898061747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:56.731329171 +0000 UTC m=+22.891719529" watchObservedRunningTime="2026-07-27 20:57:56.731811442 +0000 UTC m=+22.892201806"
Jul 27 20:57:57.384019 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:57.383992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:57.384513 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:57.384143    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:57.392127 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:57.392091    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:57:57.611274 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:57.611189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" event={"ID":"0c627c77d7235f38b874acef751ba8ac","Type":"ContainerStarted","Data":"307cde46bebe16a92e48a37b632014d85d050000a8467f0c091195c1c72bfa6d"}
Jul 27 20:57:57.613476 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:57.613443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f" event={"ID":"a4ddb2f1-b95f-4acd-8e54-9be8c509629d","Type":"ContainerStarted","Data":"0e4659026ebc1ab1742edd263000d38eaeb8a4a31cf3f8c8ca33f67905278bb1"}
Jul 27 20:57:57.615349 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:57.615052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k8vz2" event={"ID":"33ea5bb0-eb79-4cb9-9212-d14e33fc186a","Type":"ContainerStarted","Data":"d05f41d785a0baeaeea4adfaa8ec474cbd64db7a57b59df155494430a9e63b19"}
Jul 27 20:57:57.625344 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:57.625297    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" podStartSLOduration=22.62528455 podStartE2EDuration="22.62528455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:57.625017473 +0000 UTC m=+23.785407852" watchObservedRunningTime="2026-07-27 20:57:57.62528455 +0000 UTC m=+23.785674910"
Jul 27 20:57:57.637627 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:57.637589    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:58.292715 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.292549    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:57:57.392110456Z","UUID":"ee732ead-0cd4-4575-bea5-1b3141bf07af","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:57:58.294805 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.294776    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:57:58.294805 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.294816    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:57:58.310837 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.310814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:58.311413 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.311394    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:58.327312 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.327267    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k8vz2" podStartSLOduration=4.546259765 podStartE2EDuration="24.327252993s" totalImagesPullingTime="19.780993228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:57.637989565 +0000 UTC m=+23.798379924" watchObservedRunningTime="2026-07-27 20:57:58.327252993 +0000 UTC m=+24.487643352"
Jul 27 20:57:58.386654 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.386630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:57:58.387123 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:58.386753    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:57:58.387123 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.386804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:57:58.387123 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:58.386920    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:57:58.618981 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:58.618956    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4vsdl"
Jul 27 20:57:59.383639 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:59.383445    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:57:59.383639 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:57:59.383587    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:57:59.622651 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:59.622612    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f" event={"ID":"a4ddb2f1-b95f-4acd-8e54-9be8c509629d","Type":"ContainerStarted","Data":"016da1989f86b911c02b8ab13e8d58697af6400ebb04820b52b95ad65e962702"}
Jul 27 20:57:59.626455 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:59.626429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"63b8b8c8f93ec784f08fe74dd5ca5ad6176cd3e9b7ca471913cf47e15e48e4a7"}
Jul 27 20:57:59.642629 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:57:59.642513    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzs2f" podStartSLOduration=3.474120236 podStartE2EDuration="25.64249511s" totalImagesPullingTime="22.168374874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:59.641765251 +0000 UTC m=+25.802155621" watchObservedRunningTime="2026-07-27 20:57:59.64249511 +0000 UTC m=+25.802885468"
Jul 27 20:58:00.383467 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:00.383432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:00.383676 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:00.383582    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:58:00.383676 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:00.383637    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:00.383785 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:00.383734    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:58:01.383568 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.383403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:01.384061 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:01.383701    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:58:01.632508 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.632433    2579 generic.go:356] "Generic (PLEG): container finished" podID="de6f1fc5-b897-4ea8-9534-c388a45937d1" containerID="0da618b3d1117d544c17cb68e71e81c3b8ba66ff0ce8d740486e6117a72abccc" exitCode=0
Jul 27 20:58:01.632721 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.632527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerDied","Data":"0da618b3d1117d544c17cb68e71e81c3b8ba66ff0ce8d740486e6117a72abccc"}
Jul 27 20:58:01.636443 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.636419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" event={"ID":"105298c2-257c-4fdf-8ccf-63710d64d503","Type":"ContainerStarted","Data":"7b852f1387c7d74224f5614f34a20a3a075d5a6fdcf4ceb23b7fc61f0ae5a9b5"}
Jul 27 20:58:01.636719 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.636702    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:58:01.636776 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.636765    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:58:01.636834 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.636817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:58:01.652689 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.652663    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:58:01.652912 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.652896    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:58:01.683731 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:01.683689    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-59htb" podStartSLOduration=7.753428062 podStartE2EDuration="27.683669967s" totalImagesPullingTime="19.930241905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:01.682695442 +0000 UTC m=+27.843085811" watchObservedRunningTime="2026-07-27 20:58:01.683669967 +0000 UTC m=+27.844060325"
Jul 27 20:58:02.383276 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:02.383200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:02.383465 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:02.383331    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:58:02.383465 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:02.383380    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:02.383630 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:02.383500    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:58:03.165565 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.165533    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6j54f"]
Jul 27 20:58:03.165753 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.165688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:03.165827 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:03.165803    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:58:03.168524 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.168253    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6r5w"]
Jul 27 20:58:03.168524 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.168372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:03.168524 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:03.168479    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:58:03.168808 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.168789    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99n8c"]
Jul 27 20:58:03.168890 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.168875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:03.168965 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:03.168945    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:58:03.647042 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.646958    2579 generic.go:356] "Generic (PLEG): container finished" podID="de6f1fc5-b897-4ea8-9534-c388a45937d1" containerID="f5ced2ff91c70296613c9b165085855571674203315c8a1836ef4c03b2781fad" exitCode=0
Jul 27 20:58:03.647582 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:03.647037    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerDied","Data":"f5ced2ff91c70296613c9b165085855571674203315c8a1836ef4c03b2781fad"}
Jul 27 20:58:04.386739 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:04.386709    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:04.386922 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:04.386748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:04.386922 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:04.386829    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:58:04.387036 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:04.386922    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:58:05.383697 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:05.383407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:05.384126 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:05.383709    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:58:05.654151 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:05.654078    2579 generic.go:356] "Generic (PLEG): container finished" podID="de6f1fc5-b897-4ea8-9534-c388a45937d1" containerID="2ca51896172e19e4c100373efc03b645ffeab771b49ec67da9378b96468f8d3f" exitCode=0
Jul 27 20:58:05.654151 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:05.654114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerDied","Data":"2ca51896172e19e4c100373efc03b645ffeab771b49ec67da9378b96468f8d3f"}
Jul 27 20:58:06.383325 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:06.383291    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:06.383498 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:06.383305    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:06.383498 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:06.383425    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:58:06.383669 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:06.383512    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:58:07.093804 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:07.093765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:07.093832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:07.093868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.093926    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.093951    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.093965    2579 projected.go:196] Error preparing data for projected volume kube-api-access-jt2f7 for pod openshift-network-diagnostics/network-check-target-99n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.093979    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.093980    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.094019    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7 podName:efe374c0-ac88-4374-8fff-244ed6bc8789 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:39.094006076 +0000 UTC m=+65.254396418 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt2f7" (UniqueName: "kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7") pod "network-check-target-99n8c" (UID: "efe374c0-ac88-4374-8fff-244ed6bc8789") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.094036    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret podName:2fc4a764-fc39-467f-8bcd-cd0306e92175 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:39.094028637 +0000 UTC m=+65.254418974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret") pod "global-pull-secret-syncer-g6r5w" (UID: "2fc4a764-fc39-467f-8bcd-cd0306e92175") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:58:07.094215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.094058    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:58:39.094041932 +0000 UTC m=+65.254432269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:58:07.383695 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:07.383616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:07.383851 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:07.383755    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6r5w" podUID="2fc4a764-fc39-467f-8bcd-cd0306e92175"
Jul 27 20:58:08.386786 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.386758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:08.387215 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.386801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:08.387215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:08.386894    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 20:58:08.387215 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:08.387003    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99n8c" podUID="efe374c0-ac88-4374-8fff-244ed6bc8789"
Jul 27 20:58:08.672662 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.672577    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeReady"
Jul 27 20:58:08.672821 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.672756    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:58:08.709906 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.709867    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-799d488dbb-px4xj"]
Jul 27 20:58:08.713133 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.713107    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"]
Jul 27 20:58:08.713277 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.713247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.714990 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.714970    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:08.715456 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.715433    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:58:08.715644 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.715627    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:58:08.715977 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.715932    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5xm6l\""
Jul 27 20:58:08.716248 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.716231    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:58:08.718637 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.717989    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 20:58:08.718637 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.718394    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f5w29\""
Jul 27 20:58:08.718637 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.718578    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 20:58:08.721140 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.721111    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:58:08.724855 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.724835    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"]
Jul 27 20:58:08.725499 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.725478    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rfmkk"]
Jul 27 20:58:08.727456 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.727436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799d488dbb-px4xj"]
Jul 27 20:58:08.727558 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.727527    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:08.730338 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.730311    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:58:08.730744 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.730702    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvklp\""
Jul 27 20:58:08.730744 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.730729    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:58:08.730966 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.730783    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7nbzq"]
Jul 27 20:58:08.732494 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.732475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:08.734514 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.734497    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:58:08.734642 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.734615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5mn65\""
Jul 27 20:58:08.734642 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.734634    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:58:08.734891 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.734875    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:58:08.740844 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.740821    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rfmkk"]
Jul 27 20:58:08.743854 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.743823    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7nbzq"]
Jul 27 20:58:08.808023 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.807994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-bound-sa-token\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808157 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808157 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-installation-pull-secrets\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808157 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-registry-certificates\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808157 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-image-registry-private-configuration\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808157 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bc7f657e-d096-4870-b673-98d872a4c309-ca-trust-extracted\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808343 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:08.808343 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdg77\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-kube-api-access-gdg77\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808343 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-trusted-ca\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.808343 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.808218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8107055b-59c3-48dd-a14b-d552a4f1b290-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:08.909320 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-trusted-ca\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909494 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8107055b-59c3-48dd-a14b-d552a4f1b290-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:08.909494 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-bound-sa-token\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909630 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909630 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-installation-pull-secrets\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909630 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-registry-certificates\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909630 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-config-volume\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:08.909790 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-image-registry-private-configuration\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909790 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bc7f657e-d096-4870-b673-98d872a4c309-ca-trust-extracted\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909790 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909742    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:08.909790 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:08.909920 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6js9\" (UniqueName: \"kubernetes.io/projected/d4b41cc0-36f6-4c68-b670-4f541f1b0a40-kube-api-access-d6js9\") pod \"ingress-canary-7nbzq\" (UID: \"d4b41cc0-36f6-4c68-b670-4f541f1b0a40\") " pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:08.909920 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdg77\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-kube-api-access-gdg77\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.909920 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-tmp-dir\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:08.909920 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b41cc0-36f6-4c68-b670-4f541f1b0a40-cert\") pod \"ingress-canary-7nbzq\" (UID: \"d4b41cc0-36f6-4c68-b670-4f541f1b0a40\") " pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:08.909920 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.909900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phldf\" (UniqueName: \"kubernetes.io/projected/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-kube-api-access-phldf\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:08.910111 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:08.909929    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:58:08.910111 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:08.909949    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:58:08.910111 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:08.910021    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:09.410002317 +0000 UTC m=+35.570392658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:58:08.910646 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:08.910384    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:58:08.910646 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:08.910449    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:09.410434355 +0000 UTC m=+35.570824698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:58:08.910646 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.910544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-trusted-ca\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.910866 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.910695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8107055b-59c3-48dd-a14b-d552a4f1b290-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:08.910866 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.910762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bc7f657e-d096-4870-b673-98d872a4c309-ca-trust-extracted\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.910866 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.910795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-registry-certificates\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.914508 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.914478    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-installation-pull-secrets\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.914623 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.914483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-image-registry-private-configuration\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.935633 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.935555    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdg77\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-kube-api-access-gdg77\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:08.944674 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:08.944640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-bound-sa-token\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:09.010851 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.010818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-config-volume\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.011011 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.010918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.011011 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.010938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6js9\" (UniqueName: \"kubernetes.io/projected/d4b41cc0-36f6-4c68-b670-4f541f1b0a40-kube-api-access-d6js9\") pod \"ingress-canary-7nbzq\" (UID: \"d4b41cc0-36f6-4c68-b670-4f541f1b0a40\") " pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:09.011011 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.010960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-tmp-dir\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.011011 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.010976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b41cc0-36f6-4c68-b670-4f541f1b0a40-cert\") pod \"ingress-canary-7nbzq\" (UID: \"d4b41cc0-36f6-4c68-b670-4f541f1b0a40\") " pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:09.011011 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.011005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phldf\" (UniqueName: \"kubernetes.io/projected/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-kube-api-access-phldf\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.011459 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.011434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-config-volume\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.011534 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.011444    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:09.011534 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.011525    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:09.511504685 +0000 UTC m=+35.671895026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:09.011846 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.011828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-tmp-dir\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.014464 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.014442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b41cc0-36f6-4c68-b670-4f541f1b0a40-cert\") pod \"ingress-canary-7nbzq\" (UID: \"d4b41cc0-36f6-4c68-b670-4f541f1b0a40\") " pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:09.020132 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.020110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phldf\" (UniqueName: \"kubernetes.io/projected/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-kube-api-access-phldf\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.020614 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.020578    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6js9\" (UniqueName: \"kubernetes.io/projected/d4b41cc0-36f6-4c68-b670-4f541f1b0a40-kube-api-access-d6js9\") pod \"ingress-canary-7nbzq\" (UID: \"d4b41cc0-36f6-4c68-b670-4f541f1b0a40\") " pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:09.049890 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.049870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7nbzq"
Jul 27 20:58:09.383638 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.383551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:09.386092 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.386069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:58:09.414137 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.414112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:09.414462 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.414168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:09.414684 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.414662    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:58:09.414753 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.414688    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:58:09.414753 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.414687    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:58:09.414833 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.414773    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:10.414741436 +0000 UTC m=+36.575131778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:58:09.414833 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.414792    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:10.414782059 +0000 UTC m=+36.575172401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:58:09.514809 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.514774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:09.514955 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.514930    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:09.515010 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:09.515002    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:10.514980787 +0000 UTC m=+36.675371129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:09.769264 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:09.769071    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7nbzq"]
Jul 27 20:58:09.772706 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:58:09.772684    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b41cc0_36f6_4c68_b670_4f541f1b0a40.slice/crio-8471880c41874366ba2bd1fdafda6a186d4ee4f494989fab8c3e65e00abb17e4 WatchSource:0}: Error finding container 8471880c41874366ba2bd1fdafda6a186d4ee4f494989fab8c3e65e00abb17e4: Status 404 returned error can't find the container with id 8471880c41874366ba2bd1fdafda6a186d4ee4f494989fab8c3e65e00abb17e4
Jul 27 20:58:10.383728 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.383698    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:10.384280 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.384245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:10.387470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.387408    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:58:10.387470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.387421    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:58:10.387470 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.387452    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hn7dl\""
Jul 27 20:58:10.387705 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.387653    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:58:10.387760 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.387733    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cxsx8\""
Jul 27 20:58:10.423094 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.423069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:10.423513 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.423163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:10.423513 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:10.423203    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:58:10.423513 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:10.423257    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:12.423243958 +0000 UTC m=+38.583634298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:58:10.423513 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:10.423281    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:58:10.423513 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:10.423294    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:58:10.423513 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:10.423334    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:12.423319035 +0000 UTC m=+38.583709372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:58:10.524479 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.524396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:10.524593 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:10.524523    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:10.524593 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:10.524587    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:12.524568621 +0000 UTC m=+38.684958971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:10.667829 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.667750    2579 generic.go:356] "Generic (PLEG): container finished" podID="de6f1fc5-b897-4ea8-9534-c388a45937d1" containerID="47f357db49b0bbf40a75a613fba6892ac4ffb3e2fa53fc6d78191648bf820de7" exitCode=0
Jul 27 20:58:10.667965 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.667833    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerDied","Data":"47f357db49b0bbf40a75a613fba6892ac4ffb3e2fa53fc6d78191648bf820de7"}
Jul 27 20:58:10.669187 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:10.669166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7nbzq" event={"ID":"d4b41cc0-36f6-4c68-b670-4f541f1b0a40","Type":"ContainerStarted","Data":"8471880c41874366ba2bd1fdafda6a186d4ee4f494989fab8c3e65e00abb17e4"}
Jul 27 20:58:11.675739 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:11.675703    2579 generic.go:356] "Generic (PLEG): container finished" podID="de6f1fc5-b897-4ea8-9534-c388a45937d1" containerID="6fce19c0a53befa4a16ebbd1d34fd55df98ac5b53eaa1df65703e3abbc0982e3" exitCode=0
Jul 27 20:58:11.676231 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:11.675745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerDied","Data":"6fce19c0a53befa4a16ebbd1d34fd55df98ac5b53eaa1df65703e3abbc0982e3"}
Jul 27 20:58:12.439469 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.439431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:12.439628 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.439534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:12.439628 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:12.439573    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:58:12.439724 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:12.439652    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:16.43963676 +0000 UTC m=+42.600027096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:58:12.439724 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:12.439682    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:58:12.439724 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:12.439702    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:58:12.439838 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:12.439750    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:16.439737219 +0000 UTC m=+42.600127560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:58:12.540930 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.540850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:12.541080 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:12.541016    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:12.541135 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:12.541089    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:16.541068802 +0000 UTC m=+42.701459143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:12.681557 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.681522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" event={"ID":"de6f1fc5-b897-4ea8-9534-c388a45937d1","Type":"ContainerStarted","Data":"bb6d539b6f943ba9f9da01a3e0a8dd731de449dc77f5aa64c466d9608cd64346"}
Jul 27 20:58:12.683120 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.683089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7nbzq" event={"ID":"d4b41cc0-36f6-4c68-b670-4f541f1b0a40","Type":"ContainerStarted","Data":"1d23881fd5357ddc674ccaeb4aaac90373707e32ff85fe034c73cb419d0cbda6"}
Jul 27 20:58:12.706021 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.705982    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dh4n9" podStartSLOduration=8.442840585999999 podStartE2EDuration="38.705969546s" totalImagesPullingTime="30.26312896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:12.705448401 +0000 UTC m=+38.865838759" watchObservedRunningTime="2026-07-27 20:58:12.705969546 +0000 UTC m=+38.866359905"
Jul 27 20:58:12.719911 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.719867    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7nbzq" podStartSLOduration=2.1714036 podStartE2EDuration="4.719853224s" totalImagesPullingTime="2.548449624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:12.719740295 +0000 UTC m=+38.880130653" watchObservedRunningTime="2026-07-27 20:58:12.719853224 +0000 UTC m=+38.880243584"
Jul 27 20:58:12.864064 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.864000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:12.979674 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:12.979488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:13.083484 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:13.083455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:13.153739 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:13.153673    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:15.623487 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:15.623451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:15.678701 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:15.678672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:15.735945 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:15.735913    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:16.026974 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.026915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:16.083111 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.083090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:16.469216 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.469157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:16.469216 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.469208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:16.469351 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:16.469295    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:58:16.469351 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:16.469299    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:58:16.469351 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:16.469315    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:58:16.469351 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:16.469344    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:24.469331295 +0000 UTC m=+50.629721635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:58:16.469478 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:16.469357    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:24.469351083 +0000 UTC m=+50.629741423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:58:16.569769 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.569745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:16.569863 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:16.569840    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:16.569900 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:16.569878    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:24.5698665 +0000 UTC m=+50.730256836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:16.582208 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.582190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:16.644902 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.644876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:16.727634 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.727528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:16.829168 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:16.829140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:20.131514 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:20.131484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:20.482842 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:20.482765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:20.587549 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:20.587512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:24.525345 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:24.525312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:24.525785 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:24.525382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:24.525785 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:24.525480    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:58:24.525785 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:24.525497    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:58:24.525785 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:24.525520    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:58:24.525785 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:24.525554    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:40.525537014 +0000 UTC m=+66.685927351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:58:24.525785 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:24.525579    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:40.525562832 +0000 UTC m=+66.685953171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:58:24.625965 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:24.625936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:24.626111 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:24.626083    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:24.626157 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:24.626130    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:40.626119092 +0000 UTC m=+66.786509428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:33.663722 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:33.663693    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59htb"
Jul 27 20:58:33.818108 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:33.818077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:33.867859 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:33.867830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:37.606277 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:37.606240    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:37.684038 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:37.684007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:38.537434 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:38.537399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:38.600394 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:38.600336    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:38.674505 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:38.674475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:39.130737 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.130707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:39.130927 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.130752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:58:39.130927 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.130799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:39.134299 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.134280    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:58:39.134551 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.134536    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:58:39.134852 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.134839    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:58:39.140959 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:39.140942    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 20:58:39.141003 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:39.140998    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 20:59:43.140982514 +0000 UTC m=+129.301372852 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : secret "metrics-daemon-secret" not found
Jul 27 20:58:39.144216 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.144200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fc4a764-fc39-467f-8bcd-cd0306e92175-original-pull-secret\") pod \"global-pull-secret-syncer-g6r5w\" (UID: \"2fc4a764-fc39-467f-8bcd-cd0306e92175\") " pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:39.145421 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.145408    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:58:39.153311 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.153294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2f7\" (UniqueName: \"kubernetes.io/projected/efe374c0-ac88-4374-8fff-244ed6bc8789-kube-api-access-jt2f7\") pod \"network-check-target-99n8c\" (UID: \"efe374c0-ac88-4374-8fff-244ed6bc8789\") " pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:39.197440 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.197417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hn7dl\""
Jul 27 20:58:39.205771 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.205743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:39.344744 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.344714    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99n8c"]
Jul 27 20:58:39.349237 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:58:39.349206    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe374c0_ac88_4374_8fff_244ed6bc8789.slice/crio-e857679ece3dcfff0c1560cd5a1c35b5c75c5a0fe0d9cc91f3fa843d43a5802c WatchSource:0}: Error finding container e857679ece3dcfff0c1560cd5a1c35b5c75c5a0fe0d9cc91f3fa843d43a5802c: Status 404 returned error can't find the container with id e857679ece3dcfff0c1560cd5a1c35b5c75c5a0fe0d9cc91f3fa843d43a5802c
Jul 27 20:58:39.393896 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.393835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6r5w"
Jul 27 20:58:39.512729 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.512701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6r5w"]
Jul 27 20:58:39.515338 ip-10-0-143-7 kubenswrapper[2579]: W0727 20:58:39.515308    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc4a764_fc39_467f_8bcd_cd0306e92175.slice/crio-39a1f9ebca6091a44a6152e6364cdf58cc10a5821f52ea1a9ccda203e2d1fb5c WatchSource:0}: Error finding container 39a1f9ebca6091a44a6152e6364cdf58cc10a5821f52ea1a9ccda203e2d1fb5c: Status 404 returned error can't find the container with id 39a1f9ebca6091a44a6152e6364cdf58cc10a5821f52ea1a9ccda203e2d1fb5c
Jul 27 20:58:39.748584 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.748503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99n8c" event={"ID":"efe374c0-ac88-4374-8fff-244ed6bc8789","Type":"ContainerStarted","Data":"e857679ece3dcfff0c1560cd5a1c35b5c75c5a0fe0d9cc91f3fa843d43a5802c"}
Jul 27 20:58:39.749821 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:39.749790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6r5w" event={"ID":"2fc4a764-fc39-467f-8bcd-cd0306e92175","Type":"ContainerStarted","Data":"39a1f9ebca6091a44a6152e6364cdf58cc10a5821f52ea1a9ccda203e2d1fb5c"}
Jul 27 20:58:40.541053 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:40.540230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:58:40.541053 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:40.540329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:58:40.541053 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:40.540466    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:58:40.541053 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:40.540482    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:58:40.541053 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:40.540540    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 20:59:12.54052249 +0000 UTC m=+98.700912841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:58:40.541053 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:40.540965    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:58:40.541053 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:40.541019    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 20:59:12.541002865 +0000 UTC m=+98.701393221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:58:40.641687 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:40.641648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:58:40.641871 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:40.641820    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:40.641938 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:58:40.641896    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 20:59:12.641875657 +0000 UTC m=+98.802266007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:44.763465 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:44.763425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6r5w" event={"ID":"2fc4a764-fc39-467f-8bcd-cd0306e92175","Type":"ContainerStarted","Data":"4e76a46d318d014d3f4bc72dbeda5fba28226b21b5cebe6078fd729516a0021f"}
Jul 27 20:58:44.764923 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:44.764895    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99n8c" event={"ID":"efe374c0-ac88-4374-8fff-244ed6bc8789","Type":"ContainerStarted","Data":"27bed21100514ba683f40a0d69228e8200116f875fab21a68958d6f5dd7cdc3b"}
Jul 27 20:58:44.765049 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:44.765019    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:58:44.777551 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:44.777497    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g6r5w" podStartSLOduration=66.207542111 podStartE2EDuration="1m10.777483769s" totalImagesPullingTime="4.569941658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:44.777451594 +0000 UTC m=+70.937841953" watchObservedRunningTime="2026-07-27 20:58:44.777483769 +0000 UTC m=+70.937874122"
Jul 27 20:58:44.791382 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:44.791337    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-99n8c" podStartSLOduration=66.066455371 podStartE2EDuration="1m10.79131832s" totalImagesPullingTime="4.724862949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:44.790780519 +0000 UTC m=+70.951170880" watchObservedRunningTime="2026-07-27 20:58:44.79131832 +0000 UTC m=+70.951708682"
Jul 27 20:58:48.887412 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:48.887376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:48.987367 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:58:48.987339    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:12.586974 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:59:12.586942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 20:59:12.587299 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:59:12.587002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 20:59:12.587299 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:12.587095    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:59:12.587299 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:12.587101    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:59:12.587299 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:12.587165    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 21:00:16.587148481 +0000 UTC m=+162.747538818 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 20:59:12.587299 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:12.587106    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 20:59:12.587299 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:12.587231    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 21:00:16.587219469 +0000 UTC m=+162.747609805 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 20:59:12.688315 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:59:12.688275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 20:59:12.688452 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:12.688425    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:59:12.688491 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:12.688483    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 21:00:16.688470033 +0000 UTC m=+162.848860370 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 20:59:15.770752 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:59:15.770721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-99n8c"
Jul 27 20:59:43.198187 ip-10-0-143-7 kubenswrapper[2579]: I0727 20:59:43.198138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 20:59:43.198677 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:43.198302    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 20:59:43.198677 ip-10-0-143-7 kubenswrapper[2579]: E0727 20:59:43.198367    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 21:01:45.198352181 +0000 UTC m=+251.358742518 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : secret "metrics-daemon-secret" not found
Jul 27 21:00:11.727555 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:11.727499    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" podUID="bc7f657e-d096-4870-b673-98d872a4c309"
Jul 27 21:00:11.736731 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:11.736691    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s" podUID="8107055b-59c3-48dd-a14b-d552a4f1b290"
Jul 27 21:00:11.742845 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:11.742806    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rfmkk" podUID="0b24c3a4-37b3-423d-ba42-d89b835c8ce4"
Jul 27 21:00:11.966361 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:00:11.966331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:00:11.966556 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:00:11.966331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:00:11.966556 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:00:11.966341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 21:00:13.401932 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:13.401890    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 21:00:16.634424 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:00:16.634390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 21:00:16.634799 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:00:16.634453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:00:16.634799 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:16.634539    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 21:00:16.634799 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:16.634556    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:00:16.634799 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:16.634568    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799d488dbb-px4xj: secret "image-registry-tls" not found
Jul 27 21:00:16.634799 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:16.634639    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert podName:8107055b-59c3-48dd-a14b-d552a4f1b290 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:18.634619235 +0000 UTC m=+284.795009588 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqd8s" (UID: "8107055b-59c3-48dd-a14b-d552a4f1b290") : secret "networking-console-plugin-cert" not found
Jul 27 21:00:16.634799 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:16.634656    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls podName:bc7f657e-d096-4870-b673-98d872a4c309 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:18.634648664 +0000 UTC m=+284.795039001 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls") pod "image-registry-799d488dbb-px4xj" (UID: "bc7f657e-d096-4870-b673-98d872a4c309") : secret "image-registry-tls" not found
Jul 27 21:00:16.735050 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:00:16.735016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:00:16.735191 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:16.735139    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:00:16.735231 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:00:16.735199    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls podName:0b24c3a4-37b3-423d-ba42-d89b835c8ce4 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:18.735185092 +0000 UTC m=+284.895575428 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls") pod "dns-default-rfmkk" (UID: "0b24c3a4-37b3-423d-ba42-d89b835c8ce4") : secret "dns-default-metrics-tls" not found
Jul 27 21:00:26.383416 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:00:26.383332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 21:01:45.266305 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:45.266268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 21:01:45.266844 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:45.266423    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 21:01:45.266844 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:45.266492    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs podName:6fecdeae-440a-44c5-a4b1-8ce9d02bf70b nodeName:}" failed. No retries permitted until 2026-07-27 21:03:47.266472472 +0000 UTC m=+373.426862814 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs") pod "network-metrics-daemon-6j54f" (UID: "6fecdeae-440a-44c5-a4b1-8ce9d02bf70b") : secret "metrics-daemon-secret" not found
Jul 27 21:01:53.634041 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.634002    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"]
Jul 27 21:01:53.636203 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.636176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"
Jul 27 21:01:53.636522 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.636488    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"]
Jul 27 21:01:53.638322 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.638295    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.638635 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.638591    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s2s2g\""
Jul 27 21:01:53.638730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.638673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.638730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.638621    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"]
Jul 27 21:01:53.639083 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.639061    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.640508 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.640494    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vnhpt"]
Jul 27 21:01:53.640640 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.640622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:53.642503 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.642485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.643308 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.643289    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.643787 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.643415    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 21:01:53.643787 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.643488    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 21:01:53.643908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.643491    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.643908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.643516    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.643908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.643529    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 21:01:53.643908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.643565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.644214 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.644073    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mjtbc\""
Jul 27 21:01:53.644214 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.644081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vgfd8\""
Jul 27 21:01:53.644499 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.644482    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.644745 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.644729    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 21:01:53.644821 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.644731    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.644821 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.644776    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 21:01:53.644926 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.644837    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q46k7\""
Jul 27 21:01:53.652817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.652798    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 21:01:53.653889 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.653869    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"]
Jul 27 21:01:53.661517 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.661497    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"]
Jul 27 21:01:53.662260 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.662243    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vnhpt"]
Jul 27 21:01:53.675703 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.675683    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"]
Jul 27 21:01:53.725744 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-config\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.725744 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-serving-cert\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.725918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.725918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnm5\" (UniqueName: \"kubernetes.io/projected/54c38449-890a-49b4-8fb8-f729e245a78e-kube-api-access-hbnm5\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:53.725918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgh7w\" (UniqueName: \"kubernetes.io/projected/b18e0dde-f8c9-488a-95ec-4bcb5afc3e69-kube-api-access-jgh7w\") pod \"volume-data-source-validator-549c6d54cf-tlt7t\" (UID: \"b18e0dde-f8c9-488a-95ec-4bcb5afc3e69\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"
Jul 27 21:01:53.725918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.726062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:53.726062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dv8k\" (UniqueName: \"kubernetes.io/projected/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-kube-api-access-8dv8k\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.726062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.725979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-trusted-ca\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.726062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.726009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76qlf\" (UniqueName: \"kubernetes.io/projected/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-kube-api-access-76qlf\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.731896 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.731876    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"]
Jul 27 21:01:53.733841 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.733823    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dfvgc"]
Jul 27 21:01:53.733955 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.733937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.735483 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.735467    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-954df59-z652s"]
Jul 27 21:01:53.735591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.735575    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.736328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.736142    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 21:01:53.736328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.736230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 21:01:53.736328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.736281    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qlc6m\""
Jul 27 21:01:53.736686 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.736669    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.736779 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.736708    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.737337 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.737322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.742563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.741316    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.742563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.741697    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 21:01:53.742563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742056    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.742563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742304    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 21:01:53.742563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742382    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.742563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742056    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cmzlv\""
Jul 27 21:01:53.742985 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742571    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k8rk2\""
Jul 27 21:01:53.742985 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742710    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.742985 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742975    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 21:01:53.743181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.742987    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 21:01:53.743181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.743069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 21:01:53.743181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.743116    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 21:01:53.746356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.746331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"]
Jul 27 21:01:53.747211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.747188    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 21:01:53.748180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.748159    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dfvgc"]
Jul 27 21:01:53.752223 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.752181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-954df59-z652s"]
Jul 27 21:01:53.827116 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dv8k\" (UniqueName: \"kubernetes.io/projected/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-kube-api-access-8dv8k\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.827247 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e011435-9274-419a-afec-edfa583527e7-tmp\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.827247 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd6sw\" (UniqueName: \"kubernetes.io/projected/0e011435-9274-419a-afec-edfa583527e7-kube-api-access-hd6sw\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.827247 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.827247 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-serving-cert\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.827247 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89e5839-37b9-4d56-993c-303eddd9550c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.827438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pfc5\" (UniqueName: \"kubernetes.io/projected/f89e5839-37b9-4d56-993c-303eddd9550c-kube-api-access-8pfc5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.827438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89e5839-37b9-4d56-993c-303eddd9550c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.827438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnm5\" (UniqueName: \"kubernetes.io/projected/54c38449-890a-49b4-8fb8-f729e245a78e-kube-api-access-hbnm5\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:53.827438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e011435-9274-419a-afec-edfa583527e7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.827438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.827438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.827438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0e011435-9274-419a-afec-edfa583527e7-snapshots\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.827717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76qlf\" (UniqueName: \"kubernetes.io/projected/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-kube-api-access-76qlf\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.827717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-default-certificate\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.827717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:53.827717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-trusted-ca\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.827717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e011435-9274-419a-afec-edfa583527e7-serving-cert\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.827951 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:53.827729    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 21:01:53.827951 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:53.827792    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls podName:54c38449-890a-49b4-8fb8-f729e245a78e nodeName:}" failed. No retries permitted until 2026-07-27 21:01:54.327771341 +0000 UTC m=+260.488161680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls") pod "cluster-samples-operator-6748489656-ckpt9" (UID: "54c38449-890a-49b4-8fb8-f729e245a78e") : secret "samples-operator-tls" not found
Jul 27 21:01:53.827951 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-config\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.827951 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bkhh\" (UniqueName: \"kubernetes.io/projected/34e15980-9da6-4ede-b1b1-99fc74e4b99d-kube-api-access-6bkhh\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.827951 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.827951 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-stats-auth\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.827951 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgh7w\" (UniqueName: \"kubernetes.io/projected/b18e0dde-f8c9-488a-95ec-4bcb5afc3e69-kube-api-access-jgh7w\") pod \"volume-data-source-validator-549c6d54cf-tlt7t\" (UID: \"b18e0dde-f8c9-488a-95ec-4bcb5afc3e69\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"
Jul 27 21:01:53.828371 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.827977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e011435-9274-419a-afec-edfa583527e7-service-ca-bundle\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.828371 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:53.828065    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:53.828371 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:53.828114    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls podName:66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a nodeName:}" failed. No retries permitted until 2026-07-27 21:01:54.328097321 +0000 UTC m=+260.488487657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-c9mdk" (UID: "66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a") : secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:53.828371 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.828183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.828371 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.828300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-config\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.828775 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.828756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-trusted-ca\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.829778 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.829759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-serving-cert\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.836144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.836119    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dv8k\" (UniqueName: \"kubernetes.io/projected/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-kube-api-access-8dv8k\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:53.836301 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.836279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76qlf\" (UniqueName: \"kubernetes.io/projected/ac707221-d7ac-48b7-bad1-cb5a56b9f3c7-kube-api-access-76qlf\") pod \"console-operator-584dcb6b54-vnhpt\" (UID: \"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7\") " pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:53.836358 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.836279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnm5\" (UniqueName: \"kubernetes.io/projected/54c38449-890a-49b4-8fb8-f729e245a78e-kube-api-access-hbnm5\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:53.836650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.836632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgh7w\" (UniqueName: \"kubernetes.io/projected/b18e0dde-f8c9-488a-95ec-4bcb5afc3e69-kube-api-access-jgh7w\") pod \"volume-data-source-validator-549c6d54cf-tlt7t\" (UID: \"b18e0dde-f8c9-488a-95ec-4bcb5afc3e69\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"
Jul 27 21:01:53.898767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.898696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:53.929463 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e011435-9274-419a-afec-edfa583527e7-serving-cert\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.929567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bkhh\" (UniqueName: \"kubernetes.io/projected/34e15980-9da6-4ede-b1b1-99fc74e4b99d-kube-api-access-6bkhh\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.929567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-stats-auth\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.929567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e011435-9274-419a-afec-edfa583527e7-service-ca-bundle\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.929567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e011435-9274-419a-afec-edfa583527e7-tmp\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.929782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd6sw\" (UniqueName: \"kubernetes.io/projected/0e011435-9274-419a-afec-edfa583527e7-kube-api-access-hd6sw\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.929782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.929782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89e5839-37b9-4d56-993c-303eddd9550c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.929782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pfc5\" (UniqueName: \"kubernetes.io/projected/f89e5839-37b9-4d56-993c-303eddd9550c-kube-api-access-8pfc5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.929782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89e5839-37b9-4d56-993c-303eddd9550c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.929782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e011435-9274-419a-afec-edfa583527e7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.929782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.930148 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:53.929821    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:54.429794496 +0000 UTC m=+260.590184855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : configmap references non-existent config key: service-ca.crt
Jul 27 21:01:53.930148 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0e011435-9274-419a-afec-edfa583527e7-snapshots\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.930148 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.929921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-default-certificate\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.930319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.930209    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e011435-9274-419a-afec-edfa583527e7-tmp\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.930319 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:53.930286    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 21:01:53.930319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.930312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e011435-9274-419a-afec-edfa583527e7-service-ca-bundle\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.930649 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:53.930630    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:54.430588191 +0000 UTC m=+260.590978531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : secret "router-metrics-certs-default" not found
Jul 27 21:01:53.930765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.930735    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89e5839-37b9-4d56-993c-303eddd9550c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.931130 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.931108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0e011435-9274-419a-afec-edfa583527e7-snapshots\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.931240 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.931126    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e011435-9274-419a-afec-edfa583527e7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.932381 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.932357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89e5839-37b9-4d56-993c-303eddd9550c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.932687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.932667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e011435-9274-419a-afec-edfa583527e7-serving-cert\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.932788 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.932775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-stats-auth\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.932835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.932820    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-default-certificate\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.938180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.938130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bkhh\" (UniqueName: \"kubernetes.io/projected/34e15980-9da6-4ede-b1b1-99fc74e4b99d-kube-api-access-6bkhh\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:53.938502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.938480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pfc5\" (UniqueName: \"kubernetes.io/projected/f89e5839-37b9-4d56-993c-303eddd9550c-kube-api-access-8pfc5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t\" (UID: \"f89e5839-37b9-4d56-993c-303eddd9550c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:53.938569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.938558    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd6sw\" (UniqueName: \"kubernetes.io/projected/0e011435-9274-419a-afec-edfa583527e7-kube-api-access-hd6sw\") pod \"insights-operator-5885fdb759-dfvgc\" (UID: \"0e011435-9274-419a-afec-edfa583527e7\") " pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:53.947421 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.947399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"
Jul 27 21:01:53.966921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:53.966900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:01:54.043512 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.043458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:54.048315 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.048287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"
Jul 27 21:01:54.055156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.055125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-dfvgc"
Jul 27 21:01:54.080145 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.080116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t"]
Jul 27 21:01:54.083714 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:01:54.083674    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18e0dde_f8c9_488a_95ec_4bcb5afc3e69.slice/crio-f419066798254ca56333ae3e28ee98c0be7bc902d210f04f9faeb09cc3cf49f7 WatchSource:0}: Error finding container f419066798254ca56333ae3e28ee98c0be7bc902d210f04f9faeb09cc3cf49f7: Status 404 returned error can't find the container with id f419066798254ca56333ae3e28ee98c0be7bc902d210f04f9faeb09cc3cf49f7
Jul 27 21:01:54.101256 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.101229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vnhpt"]
Jul 27 21:01:54.105173 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:01:54.104734    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac707221_d7ac_48b7_bad1_cb5a56b9f3c7.slice/crio-4b3f05c9c9051e5671f45d51e0854774f848b2ffb7357e6c0e26edf1160ca846 WatchSource:0}: Error finding container 4b3f05c9c9051e5671f45d51e0854774f848b2ffb7357e6c0e26edf1160ca846: Status 404 returned error can't find the container with id 4b3f05c9c9051e5671f45d51e0854774f848b2ffb7357e6c0e26edf1160ca846
Jul 27 21:01:54.184927 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.184899    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t"]
Jul 27 21:01:54.187930 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:01:54.187904    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89e5839_37b9_4d56_993c_303eddd9550c.slice/crio-12f6e8ec28760d6c1b4f6cd30e57c8504274ec3fb0bc24edccc75e1609ad4467 WatchSource:0}: Error finding container 12f6e8ec28760d6c1b4f6cd30e57c8504274ec3fb0bc24edccc75e1609ad4467: Status 404 returned error can't find the container with id 12f6e8ec28760d6c1b4f6cd30e57c8504274ec3fb0bc24edccc75e1609ad4467
Jul 27 21:01:54.197351 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.197325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t" event={"ID":"f89e5839-37b9-4d56-993c-303eddd9550c","Type":"ContainerStarted","Data":"12f6e8ec28760d6c1b4f6cd30e57c8504274ec3fb0bc24edccc75e1609ad4467"}
Jul 27 21:01:54.198349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.198323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" event={"ID":"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7","Type":"ContainerStarted","Data":"4b3f05c9c9051e5671f45d51e0854774f848b2ffb7357e6c0e26edf1160ca846"}
Jul 27 21:01:54.199261 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.199240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t" event={"ID":"b18e0dde-f8c9-488a-95ec-4bcb5afc3e69","Type":"ContainerStarted","Data":"f419066798254ca56333ae3e28ee98c0be7bc902d210f04f9faeb09cc3cf49f7"}
Jul 27 21:01:54.203473 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.203446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dfvgc"]
Jul 27 21:01:54.206726 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:01:54.206705    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e011435_9274_419a_afec_edfa583527e7.slice/crio-dab9345ed84ba94a7fdeb07842afadc4dfc4f5ff78c3502a0ca4591ef8602f37 WatchSource:0}: Error finding container dab9345ed84ba94a7fdeb07842afadc4dfc4f5ff78c3502a0ca4591ef8602f37: Status 404 returned error can't find the container with id dab9345ed84ba94a7fdeb07842afadc4dfc4f5ff78c3502a0ca4591ef8602f37
Jul 27 21:01:54.334557 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.334532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:54.334734 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.334565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:54.334734 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:54.334697    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 21:01:54.334734 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:54.334711    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:54.334833 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:54.334754    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls podName:54c38449-890a-49b4-8fb8-f729e245a78e nodeName:}" failed. No retries permitted until 2026-07-27 21:01:55.334738289 +0000 UTC m=+261.495128631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls") pod "cluster-samples-operator-6748489656-ckpt9" (UID: "54c38449-890a-49b4-8fb8-f729e245a78e") : secret "samples-operator-tls" not found
Jul 27 21:01:54.334833 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:54.334768    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls podName:66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a nodeName:}" failed. No retries permitted until 2026-07-27 21:01:55.334762083 +0000 UTC m=+261.495152420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-c9mdk" (UID: "66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a") : secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:54.435882 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.435786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:54.435882 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:54.435831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:54.436047 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:54.435941    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 21:01:54.436047 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:54.435969    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:55.435942798 +0000 UTC m=+261.596333154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : configmap references non-existent config key: service-ca.crt
Jul 27 21:01:54.436047 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:54.435989    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:55.435982878 +0000 UTC m=+261.596373215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : secret "router-metrics-certs-default" not found
Jul 27 21:01:55.204381 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:55.204343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dfvgc" event={"ID":"0e011435-9274-419a-afec-edfa583527e7","Type":"ContainerStarted","Data":"dab9345ed84ba94a7fdeb07842afadc4dfc4f5ff78c3502a0ca4591ef8602f37"}
Jul 27 21:01:55.346391 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:55.346350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:55.346577 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:55.346417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:55.346784 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:55.346767    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 21:01:55.346860 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:55.346835    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls podName:54c38449-890a-49b4-8fb8-f729e245a78e nodeName:}" failed. No retries permitted until 2026-07-27 21:01:57.346815514 +0000 UTC m=+263.507205875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls") pod "cluster-samples-operator-6748489656-ckpt9" (UID: "54c38449-890a-49b4-8fb8-f729e245a78e") : secret "samples-operator-tls" not found
Jul 27 21:01:55.347312 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:55.347290    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:55.347404 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:55.347353    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls podName:66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a nodeName:}" failed. No retries permitted until 2026-07-27 21:01:57.347336823 +0000 UTC m=+263.507727178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-c9mdk" (UID: "66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a") : secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:55.447446 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:55.447349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:55.447663 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:55.447523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:55.447751 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:55.447719    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:57.447699408 +0000 UTC m=+263.608089749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : configmap references non-existent config key: service-ca.crt
Jul 27 21:01:55.448184 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:55.448152    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 21:01:55.448311 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:55.448237    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:57.448209533 +0000 UTC m=+263.608599882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : secret "router-metrics-certs-default" not found
Jul 27 21:01:56.208559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:56.208526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t" event={"ID":"b18e0dde-f8c9-488a-95ec-4bcb5afc3e69","Type":"ContainerStarted","Data":"2f1d16cbfade8a86d7edb9d795d8a3cfb6afe80277f8143612f92b87d9d057c6"}
Jul 27 21:01:56.224349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:56.224306    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tlt7t" podStartSLOduration=1.880467331 podStartE2EDuration="3.22429072s" totalImagesPullingTime="1.343823389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:56.222664347 +0000 UTC m=+262.383054707" watchObservedRunningTime="2026-07-27 21:01:56.22429072 +0000 UTC m=+262.384681078"
Jul 27 21:01:56.306054 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:56.306018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:56.367043 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:56.367015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:57.367813 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:57.367780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:01:57.368195 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:57.367822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:01:57.368195 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:57.367933    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 21:01:57.368195 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:57.367936    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:57.368195 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:57.368039    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls podName:54c38449-890a-49b4-8fb8-f729e245a78e nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.368016963 +0000 UTC m=+267.528407300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls") pod "cluster-samples-operator-6748489656-ckpt9" (UID: "54c38449-890a-49b4-8fb8-f729e245a78e") : secret "samples-operator-tls" not found
Jul 27 21:01:57.368195 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:57.368130    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls podName:66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.368111137 +0000 UTC m=+267.528501488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-c9mdk" (UID: "66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a") : secret "cluster-monitoring-operator-tls" not found
Jul 27 21:01:57.469286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:57.469262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:57.469378 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:57.469317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:01:57.469427 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:57.469414    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.469400808 +0000 UTC m=+267.629791145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : configmap references non-existent config key: service-ca.crt
Jul 27 21:01:57.469499 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:57.469482    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 21:01:57.469544 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:57.469537    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.469524129 +0000 UTC m=+267.629914469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : secret "router-metrics-certs-default" not found
Jul 27 21:01:58.084743 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.084710    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4s2fm"]
Jul 27 21:01:58.087273 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.087247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.089646 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.089398    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 21:01:58.090148 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.089944    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g6v4k\""
Jul 27 21:01:58.090238 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.090214    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 21:01:58.106140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.106117    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s2fm"]
Jul 27 21:01:58.138886 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.138853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:58.174473 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.174448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb9h2\" (UniqueName: \"kubernetes.io/projected/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-api-access-zb9h2\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.174634 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.174490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff0c84d-356d-4f99-a31f-04576a6db132-data-volume\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.174693 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.174649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.174693 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.174677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.174798 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.174777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ff0c84d-356d-4f99-a31f-04576a6db132-crio-socket\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.189650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.189624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:58.215646 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.215617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t" event={"ID":"f89e5839-37b9-4d56-993c-303eddd9550c","Type":"ContainerStarted","Data":"3a83437027f3c88121d66e814512acd639ccd676a813c0669f073d8563b96681"}
Jul 27 21:01:58.217166 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.217148    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/0.log"
Jul 27 21:01:58.217262 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.217188    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac707221-d7ac-48b7-bad1-cb5a56b9f3c7" containerID="3daec44b0824b818c91f18f711dc12db6c8e4292b9b490f96d111043ad0be21e" exitCode=255
Jul 27 21:01:58.217326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.217275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" event={"ID":"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7","Type":"ContainerDied","Data":"3daec44b0824b818c91f18f711dc12db6c8e4292b9b490f96d111043ad0be21e"}
Jul 27 21:01:58.217431 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.217416    2579 scope.go:117] "RemoveContainer" containerID="3daec44b0824b818c91f18f711dc12db6c8e4292b9b490f96d111043ad0be21e"
Jul 27 21:01:58.218811 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.218791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dfvgc" event={"ID":"0e011435-9274-419a-afec-edfa583527e7","Type":"ContainerStarted","Data":"a676d4d3a1cb0c3583061ffff8ba28ab16f0d2fef2df4dd8986ae82eae4ef391"}
Jul 27 21:01:58.230301 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.230254    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t" podStartSLOduration=2.033873174 podStartE2EDuration="5.230239934s" totalImagesPullingTime="3.19636676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:58.229299728 +0000 UTC m=+264.389690113" watchObservedRunningTime="2026-07-27 21:01:58.230239934 +0000 UTC m=+264.390630271"
Jul 27 21:01:58.244162 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.244114    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-dfvgc" podStartSLOduration=2.059873721 podStartE2EDuration="5.244095862s" totalImagesPullingTime="3.184222141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:58.243205809 +0000 UTC m=+264.403596169" watchObservedRunningTime="2026-07-27 21:01:58.244095862 +0000 UTC m=+264.404486225"
Jul 27 21:01:58.275556 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.275533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ff0c84d-356d-4f99-a31f-04576a6db132-crio-socket\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.275652 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.275567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb9h2\" (UniqueName: \"kubernetes.io/projected/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-api-access-zb9h2\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.275652 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.275591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff0c84d-356d-4f99-a31f-04576a6db132-data-volume\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.275749 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.275694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.275749 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.275714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ff0c84d-356d-4f99-a31f-04576a6db132-crio-socket\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.275749 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.275724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.275866 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.275797    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:58.275866 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.275846    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:01:58.775829669 +0000 UTC m=+264.936220011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:58.275938 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.275900    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.275938 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.275939    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:01:58.775927423 +0000 UTC m=+264.936317769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.276069 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.276052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff0c84d-356d-4f99-a31f-04576a6db132-data-volume\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.283175 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.283155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb9h2\" (UniqueName: \"kubernetes.io/projected/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-api-access-zb9h2\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.683692 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.683595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:58.739897 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.739863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:58.781324 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.781302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.781466 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.781334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:58.781466 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.781438    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.781546 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.781442    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:58.781546 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.781507    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:01:59.781488041 +0000 UTC m=+265.941878389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.781546 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:58.781545    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:01:59.781533484 +0000 UTC m=+265.941923824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:58.938241 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:58.938159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:59.036283 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.036243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:59.136399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.136363    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:59.223297 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.223230    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:01:59.223665 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.223651    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/0.log"
Jul 27 21:01:59.223735 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.223685    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac707221-d7ac-48b7-bad1-cb5a56b9f3c7" containerID="b657db54dc34848d8aef6398c827f7e99560404af7b6ed2027e8b30ebd891bcd" exitCode=255
Jul 27 21:01:59.223780 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.223764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" event={"ID":"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7","Type":"ContainerDied","Data":"b657db54dc34848d8aef6398c827f7e99560404af7b6ed2027e8b30ebd891bcd"}
Jul 27 21:01:59.223830 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.223802    2579 scope.go:117] "RemoveContainer" containerID="3daec44b0824b818c91f18f711dc12db6c8e4292b9b490f96d111043ad0be21e"
Jul 27 21:01:59.224037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.224016    2579 scope.go:117] "RemoveContainer" containerID="b657db54dc34848d8aef6398c827f7e99560404af7b6ed2027e8b30ebd891bcd"
Jul 27 21:01:59.224290 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:59.224268    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vnhpt_openshift-console-operator(ac707221-d7ac-48b7-bad1-cb5a56b9f3c7)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" podUID="ac707221-d7ac-48b7-bad1-cb5a56b9f3c7"
Jul 27 21:01:59.406245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.406210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:59.506502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.506429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:59.790325 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.790294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:59.790701 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:01:59.790340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:01:59.790701 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:59.790417    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:01:59.790701 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:59.790437    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:59.790701 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:59.790483    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.790466857 +0000 UTC m=+267.950857209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : configmap "kube-rbac-proxy" not found
Jul 27 21:01:59.790701 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:01:59.790498    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.790491902 +0000 UTC m=+267.950882240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:00.003230 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:00.003198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:00.066517 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:00.066436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:00.086980 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:00.086958    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfjn2_f855d0ec-cba7-4c2a-9986-5c5bee38a5e8/dns-node-resolver/0.log"
Jul 27 21:02:00.228374 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:00.228353    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:02:00.228704 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:00.228683    2579 scope.go:117] "RemoveContainer" containerID="b657db54dc34848d8aef6398c827f7e99560404af7b6ed2027e8b30ebd891bcd"
Jul 27 21:02:00.228859 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:00.228841    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vnhpt_openshift-console-operator(ac707221-d7ac-48b7-bad1-cb5a56b9f3c7)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" podUID="ac707221-d7ac-48b7-bad1-cb5a56b9f3c7"
Jul 27 21:02:01.103753 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.103721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:01.204366 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.204325    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:01.287049 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.287024    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrjxn_e9bbfe05-3cd1-4254-98de-d3e94042dd83/node-ca/0.log"
Jul 27 21:02:01.403622 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.403515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:02:01.403622 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.403556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:02:01.403844 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.403702    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 21:02:01.403844 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.403711    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 21:02:01.403844 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.403768    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls podName:66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a nodeName:}" failed. No retries permitted until 2026-07-27 21:02:09.403753339 +0000 UTC m=+275.564143679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-c9mdk" (UID: "66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a") : secret "cluster-monitoring-operator-tls" not found
Jul 27 21:02:01.403844 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.403781    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls podName:54c38449-890a-49b4-8fb8-f729e245a78e nodeName:}" failed. No retries permitted until 2026-07-27 21:02:09.403775229 +0000 UTC m=+275.564165569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls") pod "cluster-samples-operator-6748489656-ckpt9" (UID: "54c38449-890a-49b4-8fb8-f729e245a78e") : secret "samples-operator-tls" not found
Jul 27 21:02:01.504376 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.504325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:01.504376 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.504388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:01.504568 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.504486    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 21:02:01.504568 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.504518    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:09.504494603 +0000 UTC m=+275.664884955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : configmap references non-existent config key: service-ca.crt
Jul 27 21:02:01.504568 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.504540    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs podName:34e15980-9da6-4ede-b1b1-99fc74e4b99d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:09.504528258 +0000 UTC m=+275.664918618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs") pod "router-default-954df59-z652s" (UID: "34e15980-9da6-4ede-b1b1-99fc74e4b99d") : secret "router-metrics-certs-default" not found
Jul 27 21:02:01.687332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.687252    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7nbzq_d4b41cc0-36f6-4c68-b670-4f541f1b0a40/serve-healthcheck-canary/0.log"
Jul 27 21:02:01.807732 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.807678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:01.807732 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.807744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:01.807947 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.807822    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:02:01.807947 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.807852    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:01.807947 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.807892    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:05.807874515 +0000 UTC m=+271.968264852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : configmap "kube-rbac-proxy" not found
Jul 27 21:02:01.807947 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:01.807917    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:05.807903522 +0000 UTC m=+271.968293863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:01.993294 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:01.993201    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:02.478481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:02.478441    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:02.578776 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:02.578745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:02.703170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:02.703139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:02.811636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:02.811582    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:02.904448 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:02.904413    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:03.005570 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:03.005541    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:03.158577 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:03.158484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:03.756054 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:03.756017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:03.967912 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:03.967820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:02:03.967912 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:03.967886    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:02:03.968338 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:03.968321    2579 scope.go:117] "RemoveContainer" containerID="b657db54dc34848d8aef6398c827f7e99560404af7b6ed2027e8b30ebd891bcd"
Jul 27 21:02:03.968520 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:03.968498    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vnhpt_openshift-console-operator(ac707221-d7ac-48b7-bad1-cb5a56b9f3c7)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" podUID="ac707221-d7ac-48b7-bad1-cb5a56b9f3c7"
Jul 27 21:02:04.460210 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:04.460180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:04.654096 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:04.654052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:04.955965 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:04.955925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:05.161396 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:05.161364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:05.592585 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:05.592552    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:05.751438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:05.751407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:05.845801 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:05.845709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:05.845801 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:05.845750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:05.845996 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:05.845832    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:02:05.845996 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:05.845907    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:13.84588601 +0000 UTC m=+280.006276347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : configmap "kube-rbac-proxy" not found
Jul 27 21:02:05.845996 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:05.845918    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:05.845996 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:05.845952    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls podName:7ff0c84d-356d-4f99-a31f-04576a6db132 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:13.845942028 +0000 UTC m=+280.006332366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s2fm" (UID: "7ff0c84d-356d-4f99-a31f-04576a6db132") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:06.146406 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:06.146314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:06.354321 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:06.354289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:06.942163 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:06.942110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:07.009349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:07.009312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:07.355530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:07.355490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:07.553889 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:07.553856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:07.760875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:07.760786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:07.980483 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:07.980447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:08.948020 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:08.947987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:09.171343 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.171307    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:09.393708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.393672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:09.480891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.480858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:02:09.481055 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.481007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:02:09.483505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.483477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-c9mdk\" (UID: \"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:02:09.483628 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.483477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54c38449-890a-49b4-8fb8-f729e245a78e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ckpt9\" (UID: \"54c38449-890a-49b4-8fb8-f729e245a78e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:02:09.553750 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.553713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"
Jul 27 21:02:09.557239 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.557185    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:09.560767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.560745    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"
Jul 27 21:02:09.582444 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.582414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:09.582668 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.582461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:09.583060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.583041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e15980-9da6-4ede-b1b1-99fc74e4b99d-service-ca-bundle\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:09.584950 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.584915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e15980-9da6-4ede-b1b1-99fc74e4b99d-metrics-certs\") pod \"router-default-954df59-z652s\" (UID: \"34e15980-9da6-4ede-b1b1-99fc74e4b99d\") " pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:09.661103 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.661063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:09.687507 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.687475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk"]
Jul 27 21:02:09.690646 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:09.690586    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d08f71_7f5e_4bcc_b7c0_63d1a2f23d5a.slice/crio-f896507c68b85426c8f1abb85e966a56ae027a30951bef1b76dbc3491cf6dd4a WatchSource:0}: Error finding container f896507c68b85426c8f1abb85e966a56ae027a30951bef1b76dbc3491cf6dd4a: Status 404 returned error can't find the container with id f896507c68b85426c8f1abb85e966a56ae027a30951bef1b76dbc3491cf6dd4a
Jul 27 21:02:09.714240 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.714208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9"]
Jul 27 21:02:09.753661 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.753632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:09.803431 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:09.803403    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-954df59-z652s"]
Jul 27 21:02:09.806295 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:09.806275    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e15980_9da6_4ede_b1b1_99fc74e4b99d.slice/crio-450ca5a9d309575d23d819f57f4bd1a5abd1e83aa283986404bb87a1319b7dce WatchSource:0}: Error finding container 450ca5a9d309575d23d819f57f4bd1a5abd1e83aa283986404bb87a1319b7dce: Status 404 returned error can't find the container with id 450ca5a9d309575d23d819f57f4bd1a5abd1e83aa283986404bb87a1319b7dce
Jul 27 21:02:10.148450 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.148414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:10.259494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.259456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9" event={"ID":"54c38449-890a-49b4-8fb8-f729e245a78e","Type":"ContainerStarted","Data":"f8bb1dd2e07aa04b06a4382302cfeb11659c268972d897bd86116b54960f6149"}
Jul 27 21:02:10.260518 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.260492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk" event={"ID":"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a","Type":"ContainerStarted","Data":"f896507c68b85426c8f1abb85e966a56ae027a30951bef1b76dbc3491cf6dd4a"}
Jul 27 21:02:10.261730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.261710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-954df59-z652s" event={"ID":"34e15980-9da6-4ede-b1b1-99fc74e4b99d","Type":"ContainerStarted","Data":"082eff4c4c4251495ca4e12bfd482cc82607ca9d1f905fa5edea0bede67b2c9d"}
Jul 27 21:02:10.261824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.261741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-954df59-z652s" event={"ID":"34e15980-9da6-4ede-b1b1-99fc74e4b99d","Type":"ContainerStarted","Data":"450ca5a9d309575d23d819f57f4bd1a5abd1e83aa283986404bb87a1319b7dce"}
Jul 27 21:02:10.280526 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.280481    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-954df59-z652s" podStartSLOduration=17.28046203 podStartE2EDuration="17.28046203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:10.279955 +0000 UTC m=+276.440345397" watchObservedRunningTime="2026-07-27 21:02:10.28046203 +0000 UTC m=+276.440852389"
Jul 27 21:02:10.662055 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.662020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:10.665077 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.665055    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:10.751660 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:10.751616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:11.154284 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:11.154236    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:11.266382 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:11.266290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:11.267850 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:11.267819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-954df59-z652s"
Jul 27 21:02:11.328657 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:11.328623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:11.573861 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:11.573805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:11.986574 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:11.986485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:12.155272 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:12.155237    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:12.652113 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:12.652021    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:12.753004 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:12.752964    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:12.808891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:12.808841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:12.953505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:12.953406    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:13.158979 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.158938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:13.219455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.219385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:13.276027 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.275998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9" event={"ID":"54c38449-890a-49b4-8fb8-f729e245a78e","Type":"ContainerStarted","Data":"2d88dd46d5fcd53dbdbbc10ef71423e4db89c78f017cda21940ee4fa72e13da5"}
Jul 27 21:02:13.276179 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.276052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9" event={"ID":"54c38449-890a-49b4-8fb8-f729e245a78e","Type":"ContainerStarted","Data":"1b654f2d0ca025e19876dcce38fba3f92c1923754ce5bd7d530b8f1668bb8a44"}
Jul 27 21:02:13.277582 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.277558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk" event={"ID":"66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a","Type":"ContainerStarted","Data":"0ccddd1ab234027a377e4d2ea2d0c04cb5a260ec2fc130c5e74cf278930f5570"}
Jul 27 21:02:13.291400 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.291336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ckpt9" podStartSLOduration=17.7727389 podStartE2EDuration="20.291297985s" totalImagesPullingTime="2.518559085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:13.29069998 +0000 UTC m=+279.451090365" watchObservedRunningTime="2026-07-27 21:02:13.291297985 +0000 UTC m=+279.451688347"
Jul 27 21:02:13.305190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.305143    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-c9mdk" podStartSLOduration=17.705696058 podStartE2EDuration="20.30512611s" totalImagesPullingTime="2.599430052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:13.304714727 +0000 UTC m=+279.465105123" watchObservedRunningTime="2026-07-27 21:02:13.30512611 +0000 UTC m=+279.465516470"
Jul 27 21:02:13.556029 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.555980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:13.922934 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.922845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:13.922934 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.922893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:13.923457 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.923439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff0c84d-356d-4f99-a31f-04576a6db132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:13.925342 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.925325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff0c84d-356d-4f99-a31f-04576a6db132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s2fm\" (UID: \"7ff0c84d-356d-4f99-a31f-04576a6db132\") " pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:13.998530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:13.998496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s2fm"
Jul 27 21:02:14.118786 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:14.118756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s2fm"]
Jul 27 21:02:14.121567 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:14.121540    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff0c84d_356d_4f99_a31f_04576a6db132.slice/crio-b59f6e083087ec4c5656c08ab3accf0a953c6b7f6750b4a9ef046b2c252d90cc WatchSource:0}: Error finding container b59f6e083087ec4c5656c08ab3accf0a953c6b7f6750b4a9ef046b2c252d90cc: Status 404 returned error can't find the container with id b59f6e083087ec4c5656c08ab3accf0a953c6b7f6750b4a9ef046b2c252d90cc
Jul 27 21:02:14.281999 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:14.281968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s2fm" event={"ID":"7ff0c84d-356d-4f99-a31f-04576a6db132","Type":"ContainerStarted","Data":"b59f6e083087ec4c5656c08ab3accf0a953c6b7f6750b4a9ef046b2c252d90cc"}
Jul 27 21:02:14.386100 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:14.386071    2579 scope.go:117] "RemoveContainer" containerID="b657db54dc34848d8aef6398c827f7e99560404af7b6ed2027e8b30ebd891bcd"
Jul 27 21:02:14.967127 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:14.967048    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rfmkk" podUID="0b24c3a4-37b3-423d-ba42-d89b835c8ce4"
Jul 27 21:02:14.967127 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:14.967060    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" podUID="bc7f657e-d096-4870-b673-98d872a4c309"
Jul 27 21:02:14.967364 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:14.967182    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s" podUID="8107055b-59c3-48dd-a14b-d552a4f1b290"
Jul 27 21:02:15.287832 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.287797    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:02:15.288314 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.287947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:02:15.288314 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.287966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" event={"ID":"ac707221-d7ac-48b7-bad1-cb5a56b9f3c7","Type":"ContainerStarted","Data":"82c26f49f62a8c7cfdee932be4d6ec29bb8db91c88d9d547489c114c0442d335"}
Jul 27 21:02:15.288314 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.287948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 21:02:15.288314 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.288217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:02:15.288569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.288548    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:02:15.293847 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.293823    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt"
Jul 27 21:02:15.308621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.308558    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-vnhpt" podStartSLOduration=19.025161449 podStartE2EDuration="22.308538392s" totalImagesPullingTime="3.283376943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:15.307426151 +0000 UTC m=+281.467816515" watchObservedRunningTime="2026-07-27 21:02:15.308538392 +0000 UTC m=+281.468928752"
Jul 27 21:02:15.350934 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.350900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:15.451835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.451777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:15.577010 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.576880    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:15.654057 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.654024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:15.838763 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.838665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:15.891446 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:15.891407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:16.249861 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:16.249781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:16.475911 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:16.475876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:16.578293 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:16.578255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:16.860344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:16.860270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:16.916268 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:16.916221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:17.046788 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:17.046700    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:17.451210 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:17.451176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:17.684084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:17.684047    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:18.469188 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.469147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:18.667939 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.667903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:02:18.668135 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.667992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 21:02:18.671001 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.670978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"image-registry-799d488dbb-px4xj\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") " pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:02:18.671129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.671107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8107055b-59c3-48dd-a14b-d552a4f1b290-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqd8s\" (UID: \"8107055b-59c3-48dd-a14b-d552a4f1b290\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 21:02:18.769439 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.769411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:02:18.771851 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.771825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b24c3a4-37b3-423d-ba42-d89b835c8ce4-metrics-tls\") pod \"dns-default-rfmkk\" (UID: \"0b24c3a4-37b3-423d-ba42-d89b835c8ce4\") " pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:02:18.892386 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.892351    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5xm6l\""
Jul 27 21:02:18.892551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.892405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvklp\""
Jul 27 21:02:18.892551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.892411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f5w29\""
Jul 27 21:02:18.900297 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.900258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"
Jul 27 21:02:18.900297 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.900291    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:02:18.900444 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:18.900378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:02:19.297306 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:19.296736    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rfmkk"]
Jul 27 21:02:19.300268 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:19.300231    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b24c3a4_37b3_423d_ba42_d89b835c8ce4.slice/crio-b41b63b8ffd28cdeb076e65113724fcbcaa4759c94cd83d2bbb1468fbca7ffc7 WatchSource:0}: Error finding container b41b63b8ffd28cdeb076e65113724fcbcaa4759c94cd83d2bbb1468fbca7ffc7: Status 404 returned error can't find the container with id b41b63b8ffd28cdeb076e65113724fcbcaa4759c94cd83d2bbb1468fbca7ffc7
Jul 27 21:02:19.306242 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:19.305976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s2fm" event={"ID":"7ff0c84d-356d-4f99-a31f-04576a6db132","Type":"ContainerStarted","Data":"f168850a47caf283138b518c372e9a8e880bc94713407303746226771e65b13a"}
Jul 27 21:02:19.319744 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:19.319642    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s"]
Jul 27 21:02:19.322415 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:19.322386    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8107055b_59c3_48dd_a14b_d552a4f1b290.slice/crio-5f5fddfd3a21b9b314d8a4c258eebf30ef9e232c1bdd1342692ee1809fc74af8 WatchSource:0}: Error finding container 5f5fddfd3a21b9b314d8a4c258eebf30ef9e232c1bdd1342692ee1809fc74af8: Status 404 returned error can't find the container with id 5f5fddfd3a21b9b314d8a4c258eebf30ef9e232c1bdd1342692ee1809fc74af8
Jul 27 21:02:19.339458 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:19.339437    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799d488dbb-px4xj"]
Jul 27 21:02:19.341897 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:19.341877    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7f657e_d096_4870_b673_98d872a4c309.slice/crio-dd97b9237b0ab789bba99231b824b5ea747f216603202d9df5fc175726b69eb6 WatchSource:0}: Error finding container dd97b9237b0ab789bba99231b824b5ea747f216603202d9df5fc175726b69eb6: Status 404 returned error can't find the container with id dd97b9237b0ab789bba99231b824b5ea747f216603202d9df5fc175726b69eb6
Jul 27 21:02:20.281516 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.281330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:20.312874 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.312836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" event={"ID":"bc7f657e-d096-4870-b673-98d872a4c309","Type":"ContainerStarted","Data":"dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522"}
Jul 27 21:02:20.313040 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.312935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" event={"ID":"bc7f657e-d096-4870-b673-98d872a4c309","Type":"ContainerStarted","Data":"dd97b9237b0ab789bba99231b824b5ea747f216603202d9df5fc175726b69eb6"}
Jul 27 21:02:20.313771 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.313749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:02:20.315754 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.315699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s" event={"ID":"8107055b-59c3-48dd-a14b-d552a4f1b290","Type":"ContainerStarted","Data":"5f5fddfd3a21b9b314d8a4c258eebf30ef9e232c1bdd1342692ee1809fc74af8"}
Jul 27 21:02:20.317697 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.317628    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfmkk" event={"ID":"0b24c3a4-37b3-423d-ba42-d89b835c8ce4","Type":"ContainerStarted","Data":"b41b63b8ffd28cdeb076e65113724fcbcaa4759c94cd83d2bbb1468fbca7ffc7"}
Jul 27 21:02:20.333230 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.332430    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" podStartSLOduration=286.332409682 podStartE2EDuration="4m46.332409682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:20.331914694 +0000 UTC m=+286.492305078" watchObservedRunningTime="2026-07-27 21:02:20.332409682 +0000 UTC m=+286.492800023"
Jul 27 21:02:20.335426 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.335328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:20.547666 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.547569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:20.620964 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:20.620895    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:21.323643 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:21.323561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s" event={"ID":"8107055b-59c3-48dd-a14b-d552a4f1b290","Type":"ContainerStarted","Data":"1a21755c72f06bc2921cb72ae6ec1ed2f609e044279b742d7027507ba4f36684"}
Jul 27 21:02:21.338005 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:21.337959    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqd8s" podStartSLOduration=283.854025079 podStartE2EDuration="4m45.337939198s" totalImagesPullingTime="1.483914119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:21.337400387 +0000 UTC m=+287.497790747" watchObservedRunningTime="2026-07-27 21:02:21.337939198 +0000 UTC m=+287.498329558"
Jul 27 21:02:21.961453 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:21.961408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:22.059658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:22.059568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:24.335731 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.335687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s2fm" event={"ID":"7ff0c84d-356d-4f99-a31f-04576a6db132","Type":"ContainerStarted","Data":"fbc42a99478cbc89da12250f81b32d86267d8ae4684ed926bc52d285f2549000"}
Jul 27 21:02:24.337938 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.337908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfmkk" event={"ID":"0b24c3a4-37b3-423d-ba42-d89b835c8ce4","Type":"ContainerStarted","Data":"6fdd0cc1b988126508392e861899271241c59b098bf81a4cb0ed3bffcdefa0c2"}
Jul 27 21:02:24.338081 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.337962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfmkk" event={"ID":"0b24c3a4-37b3-423d-ba42-d89b835c8ce4","Type":"ContainerStarted","Data":"3ae1c86b48928b1fc4e34d280876f59707c18d2fc759647c263fc757b392111c"}
Jul 27 21:02:24.338081 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.338051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:02:24.357176 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.357127    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rfmkk" podStartSLOduration=252.227135156 podStartE2EDuration="4m16.357106664s" totalImagesPullingTime="4.129971508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:24.355177673 +0000 UTC m=+290.515568059" watchObservedRunningTime="2026-07-27 21:02:24.357106664 +0000 UTC m=+290.517497025"
Jul 27 21:02:24.463682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.463651    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f844759b-tcvl2"]
Jul 27 21:02:24.466023 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.465997    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468590    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468652    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468652    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468744    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468832    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468867    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 21:02:24.468973 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.468885    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5x9c\""
Jul 27 21:02:24.476000 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.475980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f844759b-tcvl2"]
Jul 27 21:02:24.519187 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.519160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjlsp\" (UniqueName: \"kubernetes.io/projected/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-kube-api-access-rjlsp\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.519332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.519213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-config\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.519332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.519245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-service-ca\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.519332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.519272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-oauth-config\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.519470 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.519332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-serving-cert\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.519470 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.519371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-oauth-serving-cert\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.620761 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.620687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-config\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.620761 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.620728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-service-ca\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.620761 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.620757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-oauth-config\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.621017 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.620791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-serving-cert\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.621017 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.620943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-oauth-serving-cert\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.621107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.621023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjlsp\" (UniqueName: \"kubernetes.io/projected/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-kube-api-access-rjlsp\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.621524 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.621499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-service-ca\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.621632 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.621499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-config\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.621677 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.621637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-oauth-serving-cert\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.623980 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.623957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-serving-cert\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.624061 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.624017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-oauth-config\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.629674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.629624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjlsp\" (UniqueName: \"kubernetes.io/projected/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-kube-api-access-rjlsp\") pod \"console-65f844759b-tcvl2\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") " pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.778057 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.778006    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:24.934545 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:24.934516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f844759b-tcvl2"]
Jul 27 21:02:24.939009 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:24.938978    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff17d81e_4360_4b1d_ba96_94ca5aa5e695.slice/crio-cb44b0754b449ac886bd9a398bd2a00bf1608eaca5be8a76579ea54bea9c9390 WatchSource:0}: Error finding container cb44b0754b449ac886bd9a398bd2a00bf1608eaca5be8a76579ea54bea9c9390: Status 404 returned error can't find the container with id cb44b0754b449ac886bd9a398bd2a00bf1608eaca5be8a76579ea54bea9c9390
Jul 27 21:02:25.342573 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:25.342541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f844759b-tcvl2" event={"ID":"ff17d81e-4360-4b1d-ba96-94ca5aa5e695","Type":"ContainerStarted","Data":"cb44b0754b449ac886bd9a398bd2a00bf1608eaca5be8a76579ea54bea9c9390"}
Jul 27 21:02:25.808346 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:25.808312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:25.919391 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:25.919356    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:27.354835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:27.354792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s2fm" event={"ID":"7ff0c84d-356d-4f99-a31f-04576a6db132","Type":"ContainerStarted","Data":"c6995282323e7cece8adba5c2adb06cd7fb33a341b0617117918c9edb46d5389"}
Jul 27 21:02:27.375023 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:27.374939    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4s2fm" podStartSLOduration=16.646964018 podStartE2EDuration="29.374923099s" totalImagesPullingTime="12.727959081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:01:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:27.373154028 +0000 UTC m=+293.533544408" watchObservedRunningTime="2026-07-27 21:02:27.374923099 +0000 UTC m=+293.535313457"
Jul 27 21:02:28.139338 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:28.139305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:29.384754 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:29.384719    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6j54f" podUID="6fecdeae-440a-44c5-a4b1-8ce9d02bf70b"
Jul 27 21:02:29.965753 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:29.965721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.190951 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.190922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.197729 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.197699    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"]
Jul 27 21:02:30.200190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.200169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.203427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.203400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f4vdn\""
Jul 27 21:02:30.203519 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.203400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 21:02:30.203519 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.203461    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 21:02:30.203621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.203456    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 21:02:30.211697 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.211673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"]
Jul 27 21:02:30.224797 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.224737    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h8q88"]
Jul 27 21:02:30.227863 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.227847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.230136 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.230115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 21:02:30.230261 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.230244    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 21:02:30.230328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.230214    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-28jhl\""
Jul 27 21:02:30.230328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.230316    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 21:02:30.272676 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.272650    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.272797 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.272689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f698e65d-8db6-4230-9e78-42071a912fd0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.272797 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.272723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v454n\" (UniqueName: \"kubernetes.io/projected/f698e65d-8db6-4230-9e78-42071a912fd0-kube-api-access-v454n\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.272797 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.272753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.337607 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.337576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.367257 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.367228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f844759b-tcvl2" event={"ID":"ff17d81e-4360-4b1d-ba96-94ca5aa5e695","Type":"ContainerStarted","Data":"346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b"}
Jul 27 21:02:30.373477 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373452    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-textfile\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.373558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v454n\" (UniqueName: \"kubernetes.io/projected/f698e65d-8db6-4230-9e78-42071a912fd0-kube-api-access-v454n\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.373558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-wtmp\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.373558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.373678 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:30.373645    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 27 21:02:30.373678 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-sys\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.373735 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:30.373693    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-tls podName:f698e65d-8db6-4230-9e78-42071a912fd0 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:30.873678145 +0000 UTC m=+297.034068486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-66h4j" (UID: "f698e65d-8db6-4230-9e78-42071a912fd0") : secret "openshift-state-metrics-tls" not found
Jul 27 21:02:30.373784 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-tls\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.373860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.373860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-root\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.373924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/114cbca7-b17f-43f3-b5ae-511d7ed36947-metrics-client-ca\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.373924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.373986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f698e65d-8db6-4230-9e78-42071a912fd0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.373986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-accelerators-collector-config\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.374044 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.373997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99ff\" (UniqueName: \"kubernetes.io/projected/114cbca7-b17f-43f3-b5ae-511d7ed36947-kube-api-access-v99ff\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.374515 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.374498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f698e65d-8db6-4230-9e78-42071a912fd0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.376283 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.376264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.383488 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.383469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v454n\" (UniqueName: \"kubernetes.io/projected/f698e65d-8db6-4230-9e78-42071a912fd0-kube-api-access-v454n\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.386478 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.386417    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65f844759b-tcvl2" podStartSLOduration=1.830047928 podStartE2EDuration="6.386394998s" totalImagesPullingTime="4.55634707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:30.38615121 +0000 UTC m=+296.546541582" watchObservedRunningTime="2026-07-27 21:02:30.386394998 +0000 UTC m=+296.546785368"
Jul 27 21:02:30.439228 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.439198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.474446 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.474409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.474446 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.474444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-accelerators-collector-config\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.474673 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.474474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99ff\" (UniqueName: \"kubernetes.io/projected/114cbca7-b17f-43f3-b5ae-511d7ed36947-kube-api-access-v99ff\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.474673 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.474534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-textfile\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475142 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-accelerators-collector-config\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475142 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-textfile\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-wtmp\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-sys\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-tls\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-root\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-sys\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-root\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-wtmp\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:30.475369    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 21:02:30.475452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/114cbca7-b17f-43f3-b5ae-511d7ed36947-metrics-client-ca\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.475918 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:30.475494    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-tls podName:114cbca7-b17f-43f3-b5ae-511d7ed36947 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:30.975473368 +0000 UTC m=+297.135863720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-tls") pod "node-exporter-h8q88" (UID: "114cbca7-b17f-43f3-b5ae-511d7ed36947") : secret "node-exporter-tls" not found
Jul 27 21:02:30.475918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.475792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/114cbca7-b17f-43f3-b5ae-511d7ed36947-metrics-client-ca\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.477087 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.477057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.484401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.484378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99ff\" (UniqueName: \"kubernetes.io/projected/114cbca7-b17f-43f3-b5ae-511d7ed36947-kube-api-access-v99ff\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.538333 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.538302    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.610113 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.610080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.760782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.760677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.824749 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.824719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.879179 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.879149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.881584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.881558    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f698e65d-8db6-4230-9e78-42071a912fd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-66h4j\" (UID: \"f698e65d-8db6-4230-9e78-42071a912fd0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:30.980421 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.980383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-tls\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:30.982802 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:30.982784    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/114cbca7-b17f-43f3-b5ae-511d7ed36947-node-exporter-tls\") pod \"node-exporter-h8q88\" (UID: \"114cbca7-b17f-43f3-b5ae-511d7ed36947\") " pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:31.110676 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.110641    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"
Jul 27 21:02:31.137824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.137799    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h8q88"
Jul 27 21:02:31.149192 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:31.149164    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114cbca7_b17f_43f3_b5ae_511d7ed36947.slice/crio-75acc261bb9db0828f743c1a12e51978a0221befcee4a2a16c5cec9610185ae5 WatchSource:0}: Error finding container 75acc261bb9db0828f743c1a12e51978a0221befcee4a2a16c5cec9610185ae5: Status 404 returned error can't find the container with id 75acc261bb9db0828f743c1a12e51978a0221befcee4a2a16c5cec9610185ae5
Jul 27 21:02:31.194631 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.194518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:31.249005 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.248956    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j"]
Jul 27 21:02:31.251476 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:31.251448    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf698e65d_8db6_4230_9e78_42071a912fd0.slice/crio-c92d45f668bfa0c8fd75f0d82235ceab199e193cff63f87a9ac73f84cb4448bd WatchSource:0}: Error finding container c92d45f668bfa0c8fd75f0d82235ceab199e193cff63f87a9ac73f84cb4448bd: Status 404 returned error can't find the container with id c92d45f668bfa0c8fd75f0d82235ceab199e193cff63f87a9ac73f84cb4448bd
Jul 27 21:02:31.271502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.271474    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:02:31.274922 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.274905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.278308 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:31.278088    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy-web\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret"
Jul 27 21:02:31.278308 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.278203    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:31.278853 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:31.278818    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-generated\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret"
Jul 27 21:02:31.278853 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:31.278827    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"alertmanager-main-0\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.278853 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:31.278837    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"alertmanager-trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap"
Jul 27 21:02:31.279026 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:31.278904    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret"
Jul 27 21:02:31.279196 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:31.279179    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-web-config\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret"
Jul 27 21:02:31.279648 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.279635    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bqtfv\""
Jul 27 21:02:31.279827 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.279808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 21:02:31.280073 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.280058    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 21:02:31.280288 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.280274    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 21:02:31.281223 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:31.281200    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls-assets-0\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret"
Jul 27 21:02:31.308772 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.308741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:02:31.372481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.372454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8q88" event={"ID":"114cbca7-b17f-43f3-b5ae-511d7ed36947","Type":"ContainerStarted","Data":"75acc261bb9db0828f743c1a12e51978a0221befcee4a2a16c5cec9610185ae5"}
Jul 27 21:02:31.374659 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.374635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j" event={"ID":"f698e65d-8db6-4230-9e78-42071a912fd0","Type":"ContainerStarted","Data":"aec448e3618ccede73c87cd1b4730e1e6b2495c11b41c699a5bc04796fb7f49d"}
Jul 27 21:02:31.374760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.374685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j" event={"ID":"f698e65d-8db6-4230-9e78-42071a912fd0","Type":"ContainerStarted","Data":"c92d45f668bfa0c8fd75f0d82235ceab199e193cff63f87a9ac73f84cb4448bd"}
Jul 27 21:02:31.383673 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.383772 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.383830 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-config-out\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.383830 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.383931 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.383931 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.383931 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.384078 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.384078 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.383981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.384078 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.384000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.384078 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.384049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82q8n\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-kube-api-access-82q8n\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.384078 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.384073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.384313 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.384093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.484673 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.484642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.484673 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.484679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.484720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-config-out\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.484762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.484823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.484850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.484947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.485019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.485046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.485086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.485126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82q8n\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-kube-api-access-82q8n\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485648 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.485176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485648 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.485205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.485648 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.485248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.486315 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.486290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.487745 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.487719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.487831 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.487797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-config-out\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.487935 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.487920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.488374 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.488351    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.493991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.493969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82q8n\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-kube-api-access-82q8n\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:31.521362 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:31.521322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:32.199990 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.199658    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7868b8b499-pswvv"]
Jul 27 21:02:32.205428 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.205402    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.207990 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.207967    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 21:02:32.208144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.207971    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 21:02:32.208219 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.208189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hg7fc\""
Jul 27 21:02:32.208219 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.208198    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 21:02:32.208313 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.207985    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 21:02:32.208383 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.208132    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8kv9gl85b16a\""
Jul 27 21:02:32.209468 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.209449    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 21:02:32.211637 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.211617    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7868b8b499-pswvv"]
Jul 27 21:02:32.293151 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6jj\" (UniqueName: \"kubernetes.io/projected/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-kube-api-access-7n6jj\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.293313 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.293313 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.293313 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.293489 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-metrics-client-ca\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.293489 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-grpc-tls\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.293489 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-tls\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.293489 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.293472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.380475 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.380439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j" event={"ID":"f698e65d-8db6-4230-9e78-42071a912fd0","Type":"ContainerStarted","Data":"2593c5bf2cbea713bb7bd47766b0718a9559128c512077b95878b74ae5c67b91"}
Jul 27 21:02:32.395001 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.394966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6jj\" (UniqueName: \"kubernetes.io/projected/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-kube-api-access-7n6jj\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.395157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.395015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.395157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.395087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.395157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.395114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.395157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.395143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-metrics-client-ca\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.395372 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.395164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-grpc-tls\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.395372 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.395331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-tls\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.395451 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.395367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.396248 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.396180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-metrics-client-ca\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.398558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.398531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.398989 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.398967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.399126 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.399107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.399457 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.399436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.399721 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.399698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-thanos-querier-tls\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.399828 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.399806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-secret-grpc-tls\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.403834 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.403812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6jj\" (UniqueName: \"kubernetes.io/projected/dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce-kube-api-access-7n6jj\") pod \"thanos-querier-7868b8b499-pswvv\" (UID: \"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce\") " pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485859    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-kube-rbac-proxy-web: failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485884    2579 projected.go:266] Couldn't get secret openshift-monitoring/alertmanager-main-tls-assets-0: failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485882    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-web-config: failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485901    2579 projected.go:196] Error preparing data for projected volume tls-assets for pod openshift-monitoring/alertmanager-main-0: failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485925    2579 configmap.go:193] Couldn't get configMap openshift-monitoring/alertmanager-trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485946    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web podName:efa42659-1f1f-474b-b4e6-01e5a410038d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:32.985920936 +0000 UTC m=+299.146311280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-kube-rbac-proxy-web" (UniqueName: "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web") pod "alertmanager-main-0" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d") : failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485897    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.485958    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485864    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-generated: failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485973    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config podName:efa42659-1f1f-474b-b4e6-01e5a410038d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:32.985954362 +0000 UTC m=+299.146344718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "web-config" (UniqueName: "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config") pod "alertmanager-main-0" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d") : failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.485996    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets podName:efa42659-1f1f-474b-b4e6-01e5a410038d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:32.985987018 +0000 UTC m=+299.146377356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-assets" (UniqueName: "kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets") pod "alertmanager-main-0" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d") : failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.486012    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle podName:efa42659-1f1f-474b-b4e6-01e5a410038d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:32.986003164 +0000 UTC m=+299.146393501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d") : failed to sync configmap cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.486027    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls podName:efa42659-1f1f-474b-b4e6-01e5a410038d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:32.986019125 +0000 UTC m=+299.146409463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d") : failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.486090 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:02:32.486043    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume podName:efa42659-1f1f-474b-b4e6-01e5a410038d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:32.986034559 +0000 UTC m=+299.146424898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume") pod "alertmanager-main-0" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d") : failed to sync secret cache: timed out waiting for the condition
Jul 27 21:02:32.518518 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.518471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:32.524229 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.524210    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 21:02:32.579471 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.577547    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 21:02:32.650412 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.650388    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 21:02:32.663638 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.663612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7868b8b499-pswvv"]
Jul 27 21:02:32.667447 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:32.667408    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdc2bb2_7855_49e0_a5aa_ff8e72faf9ce.slice/crio-682a1f7eddb4073e8be80646995a92af3b21cb3ca39c79dc30cb66dad8c7b66f WatchSource:0}: Error finding container 682a1f7eddb4073e8be80646995a92af3b21cb3ca39c79dc30cb66dad8c7b66f: Status 404 returned error can't find the container with id 682a1f7eddb4073e8be80646995a92af3b21cb3ca39c79dc30cb66dad8c7b66f
Jul 27 21:02:32.814866 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.814836    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 21:02:32.836571 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:32.836542    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 21:02:33.002079 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.002045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.002229 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.002111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.002229 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.002161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.002229 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.002197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.002393 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.002256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.002393 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.002302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.003127 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.002985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.004899 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.004870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.005018 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.004913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.005100 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.005074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.005150 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.005089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.005150 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.005117    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config\") pod \"alertmanager-main-0\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.088565 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.088489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:02:33.226554 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.226530    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:02:33.228914 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:33.228888    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa42659_1f1f_474b_b4e6_01e5a410038d.slice/crio-cc803a8300bd200d86b4d973648b7e5d8c30702fb023c644a4d327a6a710dc6d WatchSource:0}: Error finding container cc803a8300bd200d86b4d973648b7e5d8c30702fb023c644a4d327a6a710dc6d: Status 404 returned error can't find the container with id cc803a8300bd200d86b4d973648b7e5d8c30702fb023c644a4d327a6a710dc6d
Jul 27 21:02:33.349213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.349133    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:33.385014 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.384982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" event={"ID":"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce","Type":"ContainerStarted","Data":"682a1f7eddb4073e8be80646995a92af3b21cb3ca39c79dc30cb66dad8c7b66f"}
Jul 27 21:02:33.386095 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.386072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerStarted","Data":"cc803a8300bd200d86b4d973648b7e5d8c30702fb023c644a4d327a6a710dc6d"}
Jul 27 21:02:33.388107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.388078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j" event={"ID":"f698e65d-8db6-4230-9e78-42071a912fd0","Type":"ContainerStarted","Data":"1df66516b98c39d7b04dd79f94f3e359a05baeb99e88b5bbaa7bb2b2346aa398"}
Jul 27 21:02:33.389665 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.389643    2579 generic.go:356] "Generic (PLEG): container finished" podID="114cbca7-b17f-43f3-b5ae-511d7ed36947" containerID="be58dea0f59a90e4dc1ceeb285ad1173a2442f8b1b0523a372f0124b48062894" exitCode=0
Jul 27 21:02:33.389766 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.389676    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8q88" event={"ID":"114cbca7-b17f-43f3-b5ae-511d7ed36947","Type":"ContainerDied","Data":"be58dea0f59a90e4dc1ceeb285ad1173a2442f8b1b0523a372f0124b48062894"}
Jul 27 21:02:33.403925 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.403879    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66h4j" podStartSLOduration=2.268347808 podStartE2EDuration="3.403863321s" totalImagesPullingTime="1.135515513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:33.403429538 +0000 UTC m=+299.563819920" watchObservedRunningTime="2026-07-27 21:02:33.403863321 +0000 UTC m=+299.564253680"
Jul 27 21:02:33.407644 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.407618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:33.861300 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.861262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:33.915180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:33.915131    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:34.246660 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.246571    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:02:34.246806 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.246588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:02:34.260151 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.260128    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 21:02:34.344975 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.344949    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rfmkk"
Jul 27 21:02:34.398882 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.398653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8q88" event={"ID":"114cbca7-b17f-43f3-b5ae-511d7ed36947","Type":"ContainerStarted","Data":"e696b5d278da77bdef828e5895e918eb6c0b71d1dd9372964d77ceef037b26f1"}
Jul 27 21:02:34.398882 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.398730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8q88" event={"ID":"114cbca7-b17f-43f3-b5ae-511d7ed36947","Type":"ContainerStarted","Data":"88923b512f107e1b99d357b100d959a237e5e3a2b546a2efec36e225e2ba5201"}
Jul 27 21:02:34.418085 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.415901    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h8q88" podStartSLOduration=2.995590072 podStartE2EDuration="4.415880101s" totalImagesPullingTime="1.338299458s" totalInitContainerRuntime="81.990571ms" isStatefulPod=true podCreationTimestamp="2026-07-27 21:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:34.415429515 +0000 UTC m=+300.575819875" watchObservedRunningTime="2026-07-27 21:02:34.415880101 +0000 UTC m=+300.576270461"
Jul 27 21:02:34.778895 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.778852    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:34.779097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.778932    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:34.784357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.784332    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:34.999456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.999420    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"]
Jul 27 21:02:34.999456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:34.999442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:35.002109 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.002080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.004591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.004564    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 21:02:35.004736 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.004592    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zb8fb\""
Jul 27 21:02:35.008779 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.008723    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f844759b-tcvl2"]
Jul 27 21:02:35.010853 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.010826    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"]
Jul 27 21:02:35.031968 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.031900    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cc5897c7b-xlktv"]
Jul 27 21:02:35.034525 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.034507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.041433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.041414    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 21:02:35.042756 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.042734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc5897c7b-xlktv"]
Jul 27 21:02:35.122433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-oauth-serving-cert\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.122674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-trusted-ca-bundle\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.122674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d82b5151-dfb1-4f53-a7a8-eda72e10383c-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-wlpb5\" (UID: \"d82b5151-dfb1-4f53-a7a8-eda72e10383c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.122674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-oauth-config\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.122674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-config\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.122674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r99lb\" (UniqueName: \"kubernetes.io/projected/aeb2eccc-4405-4198-809f-c24df1cd39bc-kube-api-access-r99lb\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.122674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tbl\" (UniqueName: \"kubernetes.io/projected/d82b5151-dfb1-4f53-a7a8-eda72e10383c-kube-api-access-k9tbl\") pod \"monitoring-plugin-68b7fc9574-wlpb5\" (UID: \"d82b5151-dfb1-4f53-a7a8-eda72e10383c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.122881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-serving-cert\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.122881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.122714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-service-ca\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.157013 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.156983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:35.223425 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-oauth-serving-cert\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.223546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-trusted-ca-bundle\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.223546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d82b5151-dfb1-4f53-a7a8-eda72e10383c-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-wlpb5\" (UID: \"d82b5151-dfb1-4f53-a7a8-eda72e10383c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.223546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-oauth-config\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.223740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-config\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.223740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r99lb\" (UniqueName: \"kubernetes.io/projected/aeb2eccc-4405-4198-809f-c24df1cd39bc-kube-api-access-r99lb\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.223740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tbl\" (UniqueName: \"kubernetes.io/projected/d82b5151-dfb1-4f53-a7a8-eda72e10383c-kube-api-access-k9tbl\") pod \"monitoring-plugin-68b7fc9574-wlpb5\" (UID: \"d82b5151-dfb1-4f53-a7a8-eda72e10383c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.223740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-serving-cert\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.223929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.223753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-service-ca\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.224741 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.224715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-oauth-serving-cert\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.224851 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.224724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-service-ca\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.224986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.224951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-config\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.224986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.224961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-trusted-ca-bundle\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.227550 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.227526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-serving-cert\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.227989 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.227968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-oauth-config\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.228108 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.228083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d82b5151-dfb1-4f53-a7a8-eda72e10383c-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-wlpb5\" (UID: \"d82b5151-dfb1-4f53-a7a8-eda72e10383c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.232087 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.232061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tbl\" (UniqueName: \"kubernetes.io/projected/d82b5151-dfb1-4f53-a7a8-eda72e10383c-kube-api-access-k9tbl\") pod \"monitoring-plugin-68b7fc9574-wlpb5\" (UID: \"d82b5151-dfb1-4f53-a7a8-eda72e10383c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.232716 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.232695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r99lb\" (UniqueName: \"kubernetes.io/projected/aeb2eccc-4405-4198-809f-c24df1cd39bc-kube-api-access-r99lb\") pod \"console-7cc5897c7b-xlktv\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") " pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.299282 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.299253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:35.315064 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.315042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:35.345420 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.345384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:35.364621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.364578    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:02:35.408170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.407990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" event={"ID":"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce","Type":"ContainerStarted","Data":"3e9e6733a09577596b0def57686a63b19823a25be7d6a9eeac56e41b3c22948f"}
Jul 27 21:02:35.408170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.408082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" event={"ID":"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce","Type":"ContainerStarted","Data":"4f72158c139412467428a0e6146bce48c9f6f02eb73b6c636ea67e63a07bea0b"}
Jul 27 21:02:35.408170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.408122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" event={"ID":"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce","Type":"ContainerStarted","Data":"f87fd3161d41ad30d66f83e929fa42eed0815bb9b134b90ad7d8b9ea0f377579"}
Jul 27 21:02:35.411705 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.411650    2579 generic.go:356] "Generic (PLEG): container finished" podID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerID="c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61" exitCode=0
Jul 27 21:02:35.412697 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.412586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61"}
Jul 27 21:02:35.420760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.420647    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:02:35.461312 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.461284    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"]
Jul 27 21:02:35.465359 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:35.465331    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82b5151_dfb1_4f53_a7a8_eda72e10383c.slice/crio-0c092fb826c82b1118d836283bb87c68aa8ab2db59725b7e68a515f05139d023 WatchSource:0}: Error finding container 0c092fb826c82b1118d836283bb87c68aa8ab2db59725b7e68a515f05139d023: Status 404 returned error can't find the container with id 0c092fb826c82b1118d836283bb87c68aa8ab2db59725b7e68a515f05139d023
Jul 27 21:02:35.495889 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.495862    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc5897c7b-xlktv"]
Jul 27 21:02:35.498874 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:02:35.498850    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb2eccc_4405_4198_809f_c24df1cd39bc.slice/crio-e6c692c888980fab57116c57d7bd8e581a97d009e87ed23d1bdd17db9686eb86 WatchSource:0}: Error finding container e6c692c888980fab57116c57d7bd8e581a97d009e87ed23d1bdd17db9686eb86: Status 404 returned error can't find the container with id e6c692c888980fab57116c57d7bd8e581a97d009e87ed23d1bdd17db9686eb86
Jul 27 21:02:35.603852 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.603810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:35.704156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.704125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:35.805421 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:35.805334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:36.419750 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:36.419670    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5" event={"ID":"d82b5151-dfb1-4f53-a7a8-eda72e10383c","Type":"ContainerStarted","Data":"0c092fb826c82b1118d836283bb87c68aa8ab2db59725b7e68a515f05139d023"}
Jul 27 21:02:36.422582 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:36.422041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc5897c7b-xlktv" event={"ID":"aeb2eccc-4405-4198-809f-c24df1cd39bc","Type":"ContainerStarted","Data":"1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34"}
Jul 27 21:02:36.422582 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:36.422089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc5897c7b-xlktv" event={"ID":"aeb2eccc-4405-4198-809f-c24df1cd39bc","Type":"ContainerStarted","Data":"e6c692c888980fab57116c57d7bd8e581a97d009e87ed23d1bdd17db9686eb86"}
Jul 27 21:02:36.461947 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:36.461894    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cc5897c7b-xlktv" podStartSLOduration=1.461874653 podStartE2EDuration="1.461874653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:36.459549615 +0000 UTC m=+302.619939975" watchObservedRunningTime="2026-07-27 21:02:36.461874653 +0000 UTC m=+302.622265010"
Jul 27 21:02:37.430590 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.430501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" event={"ID":"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce","Type":"ContainerStarted","Data":"a6d1f7f31eac629b4978ecfd79344daee3d65d05071a0caf3282ca6d9ca19ea0"}
Jul 27 21:02:37.431058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.430655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" event={"ID":"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce","Type":"ContainerStarted","Data":"98d1e29d2c8f9d7194c07a48b373722d0f09b4abefc822eba4ac260c59d01d39"}
Jul 27 21:02:37.431058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.430685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" event={"ID":"dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce","Type":"ContainerStarted","Data":"2b8a71e226209bcddb64ba0e0d5734c0364d02eca6b2b39d43351a45db2bf700"}
Jul 27 21:02:37.431058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.430727    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:37.433181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.433140    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerStarted","Data":"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"}
Jul 27 21:02:37.433308 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.433218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerStarted","Data":"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"}
Jul 27 21:02:37.451991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.451963    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:37.456046 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:37.456006    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv" podStartSLOduration=1.931091653 podStartE2EDuration="5.455990997s" totalImagesPullingTime="3.524899344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:37.454414133 +0000 UTC m=+303.614804512" watchObservedRunningTime="2026-07-27 21:02:37.455990997 +0000 UTC m=+303.616381356"
Jul 27 21:02:38.440507 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.440466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerStarted","Data":"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"}
Jul 27 21:02:38.440932 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.440557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerStarted","Data":"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"}
Jul 27 21:02:38.440932 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.440624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerStarted","Data":"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"}
Jul 27 21:02:38.440932 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.440665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerStarted","Data":"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"}
Jul 27 21:02:38.442104 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.442081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5" event={"ID":"d82b5151-dfb1-4f53-a7a8-eda72e10383c","Type":"ContainerStarted","Data":"a28b8ff0a6b13db1fa8cd486954ff8cfbf4db516209d3ecb6a0c41e88100408e"}
Jul 27 21:02:38.442354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.442328    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:38.447300 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.447279    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5"
Jul 27 21:02:38.477874 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.477827    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.916967348 podStartE2EDuration="7.477809244s" totalImagesPullingTime="3.541066752s" totalInitContainerRuntime="19.775144ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:38.476402469 +0000 UTC m=+304.636792844" watchObservedRunningTime="2026-07-27 21:02:38.477809244 +0000 UTC m=+304.638199606"
Jul 27 21:02:38.510769 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.510715    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-wlpb5" podStartSLOduration=2.3849028150000002 podStartE2EDuration="4.510700527s" totalImagesPullingTime="2.125797712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:38.508320789 +0000 UTC m=+304.668711147" watchObservedRunningTime="2026-07-27 21:02:38.510700527 +0000 UTC m=+304.671090887"
Jul 27 21:02:38.905031 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.904986    2579 patch_prober.go:28] interesting pod/image-registry-799d488dbb-px4xj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 21:02:38.905216 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:38.905041    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" podUID="bc7f657e-d096-4870-b673-98d872a4c309" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:02:41.121732 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:41.121698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:41.177139 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:41.177106    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:42.242524 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:42.242488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:42.332338 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:42.332313    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:02:42.351922 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:42.351891    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:42.640090 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:42.640058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:42.701504 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:42.701467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:43.383887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:43.383854    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 21:02:43.448080 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:43.448053    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7868b8b499-pswvv"
Jul 27 21:02:43.489502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:43.489436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:43.575549 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:43.575513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:44.233241 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:44.233204    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-799d488dbb-px4xj"]
Jul 27 21:02:44.364607 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:44.364580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:44.467269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:44.467231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:44.696961 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:44.696935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:44.771054 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:44.771023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:45.345969 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:45.345934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:45.346143 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:45.346004    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:45.350418 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:45.350396    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:45.473045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:45.473020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:02:45.727691 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:45.727589    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:45.826624 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:45.826578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:50.496148 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:50.496110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:50.597902 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:50.597859    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:50.717083 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:50.717050    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:50.785356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:50.785324    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:52.497440 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:52.497403    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:52.598507 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:52.598476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:55.703880 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:55.703842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:55.809148 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:02:55.809109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:01.445853 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.445792    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65f844759b-tcvl2" podUID="ff17d81e-4360-4b1d-ba96-94ca5aa5e695" containerName="console" containerID="cri-o://346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b" gracePeriod=15
Jul 27 21:03:01.692587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.692563    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:03:01.763784 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.763701    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-oauth-serving-cert\") pod \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") "
Jul 27 21:03:01.763784 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.763758    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-config\") pod \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") "
Jul 27 21:03:01.764009 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.763787    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjlsp\" (UniqueName: \"kubernetes.io/projected/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-kube-api-access-rjlsp\") pod \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") "
Jul 27 21:03:01.764009 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.763898    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-service-ca\") pod \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") "
Jul 27 21:03:01.764009 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.763931    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-oauth-config\") pod \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") "
Jul 27 21:03:01.764009 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.763957    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-serving-cert\") pod \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\" (UID: \"ff17d81e-4360-4b1d-ba96-94ca5aa5e695\") "
Jul 27 21:03:01.764212 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.764188    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-config" (OuterVolumeSpecName: "console-config") pod "ff17d81e-4360-4b1d-ba96-94ca5aa5e695" (UID: "ff17d81e-4360-4b1d-ba96-94ca5aa5e695"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:01.764260 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.764141    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff17d81e-4360-4b1d-ba96-94ca5aa5e695" (UID: "ff17d81e-4360-4b1d-ba96-94ca5aa5e695"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:01.764555 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.764516    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff17d81e-4360-4b1d-ba96-94ca5aa5e695" (UID: "ff17d81e-4360-4b1d-ba96-94ca5aa5e695"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:01.766232 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.766203    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-kube-api-access-rjlsp" (OuterVolumeSpecName: "kube-api-access-rjlsp") pod "ff17d81e-4360-4b1d-ba96-94ca5aa5e695" (UID: "ff17d81e-4360-4b1d-ba96-94ca5aa5e695"). InnerVolumeSpecName "kube-api-access-rjlsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:01.766232 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.766201    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff17d81e-4360-4b1d-ba96-94ca5aa5e695" (UID: "ff17d81e-4360-4b1d-ba96-94ca5aa5e695"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:01.766368 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.766242    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff17d81e-4360-4b1d-ba96-94ca5aa5e695" (UID: "ff17d81e-4360-4b1d-ba96-94ca5aa5e695"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:01.864863 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.864829    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:01.864863 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.864858    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-oauth-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:01.865035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.864871    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:01.865035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.864883    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-oauth-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:01.865035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.864894    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-console-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:01.865035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:01.864906    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjlsp\" (UniqueName: \"kubernetes.io/projected/ff17d81e-4360-4b1d-ba96-94ca5aa5e695-kube-api-access-rjlsp\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:02.537101 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.537068    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff17d81e-4360-4b1d-ba96-94ca5aa5e695" containerID="346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b" exitCode=0
Jul 27 21:03:02.537541 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.537113    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f844759b-tcvl2"
Jul 27 21:03:02.537541 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.537149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f844759b-tcvl2" event={"ID":"ff17d81e-4360-4b1d-ba96-94ca5aa5e695","Type":"ContainerDied","Data":"346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b"}
Jul 27 21:03:02.537541 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.537217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f844759b-tcvl2" event={"ID":"ff17d81e-4360-4b1d-ba96-94ca5aa5e695","Type":"ContainerDied","Data":"cb44b0754b449ac886bd9a398bd2a00bf1608eaca5be8a76579ea54bea9c9390"}
Jul 27 21:03:02.537541 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.537242    2579 scope.go:117] "RemoveContainer" containerID="346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b"
Jul 27 21:03:02.547579 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.547563    2579 scope.go:117] "RemoveContainer" containerID="346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b"
Jul 27 21:03:02.547906 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:02.547881    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b\": container with ID starting with 346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b not found: ID does not exist" containerID="346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b"
Jul 27 21:03:02.547974 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.547911    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b"} err="failed to get container status \"346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b\": rpc error: code = NotFound desc = could not find container \"346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b\": container with ID starting with 346df5755ed5fa4bf5558cafcc2588ff1a2f8e85ce1bee75ed6ed4b01b040f9b not found: ID does not exist"
Jul 27 21:03:02.569377 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.569350    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f844759b-tcvl2"]
Jul 27 21:03:02.588032 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:02.588012    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f844759b-tcvl2"]
Jul 27 21:03:04.387851 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:04.387818    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff17d81e-4360-4b1d-ba96-94ca5aa5e695" path="/var/lib/kubelet/pods/ff17d81e-4360-4b1d-ba96-94ca5aa5e695/volumes"
Jul 27 21:03:04.776083 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:04.776052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:04.834208 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:04.834177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:05.492615 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:05.492576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:05.564434 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:05.564399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:09.253674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.253575    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" podUID="bc7f657e-d096-4870-b673-98d872a4c309" containerName="registry" containerID="cri-o://dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522" gracePeriod=30
Jul 27 21:03:09.504492 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.504435    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:03:09.565573 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.565543    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc7f657e-d096-4870-b673-98d872a4c309" containerID="dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522" exitCode=0
Jul 27 21:03:09.565738 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.565592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" event={"ID":"bc7f657e-d096-4870-b673-98d872a4c309","Type":"ContainerDied","Data":"dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522"}
Jul 27 21:03:09.565738 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.565681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799d488dbb-px4xj" event={"ID":"bc7f657e-d096-4870-b673-98d872a4c309","Type":"ContainerDied","Data":"dd97b9237b0ab789bba99231b824b5ea747f216603202d9df5fc175726b69eb6"}
Jul 27 21:03:09.565738 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.565612    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799d488dbb-px4xj"
Jul 27 21:03:09.565738 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.565703    2579 scope.go:117] "RemoveContainer" containerID="dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522"
Jul 27 21:03:09.573702 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.573680    2579 scope.go:117] "RemoveContainer" containerID="dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522"
Jul 27 21:03:09.573987 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:09.573963    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522\": container with ID starting with dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522 not found: ID does not exist" containerID="dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522"
Jul 27 21:03:09.574038 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.573997    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522"} err="failed to get container status \"dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522\": rpc error: code = NotFound desc = could not find container \"dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522\": container with ID starting with dca4ff6d45e295279b507eedcbf64469ca80be53de473787bfda17d466cb1522 not found: ID does not exist"
Jul 27 21:03:09.632267 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632238    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-trusted-ca\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632378 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632284    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdg77\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-kube-api-access-gdg77\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632378 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632333    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-registry-certificates\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632493 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632425    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bc7f657e-d096-4870-b673-98d872a4c309-ca-trust-extracted\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632493 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632453    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632492    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-installation-pull-secrets\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632519    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-bound-sa-token\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632763 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632558    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-image-registry-private-configuration\") pod \"bc7f657e-d096-4870-b673-98d872a4c309\" (UID: \"bc7f657e-d096-4870-b673-98d872a4c309\") "
Jul 27 21:03:09.632964 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632777    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:09.633038 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.632850    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:09.633508 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.633472    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-registry-certificates\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.633508 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.633503    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc7f657e-d096-4870-b673-98d872a4c309-trusted-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.635517 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.635485    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:09.635633 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.635505    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:09.635633 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.635576    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:09.635633 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.635594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-kube-api-access-gdg77" (OuterVolumeSpecName: "kube-api-access-gdg77") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "kube-api-access-gdg77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:09.635633 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.635617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:09.640967 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.640933    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7f657e-d096-4870-b673-98d872a4c309-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bc7f657e-d096-4870-b673-98d872a4c309" (UID: "bc7f657e-d096-4870-b673-98d872a4c309"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:09.734481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.734440    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bc7f657e-d096-4870-b673-98d872a4c309-ca-trust-extracted\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.734481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.734476    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-registry-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.734481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.734485    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-installation-pull-secrets\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.734481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.734494    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-bound-sa-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.734747 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.734504    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bc7f657e-d096-4870-b673-98d872a4c309-image-registry-private-configuration\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.734747 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.734513    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdg77\" (UniqueName: \"kubernetes.io/projected/bc7f657e-d096-4870-b673-98d872a4c309-kube-api-access-gdg77\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:09.888245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.888218    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-799d488dbb-px4xj"]
Jul 27 21:03:09.892282 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:09.892260    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-799d488dbb-px4xj"]
Jul 27 21:03:10.388340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:10.388310    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7f657e-d096-4870-b673-98d872a4c309" path="/var/lib/kubelet/pods/bc7f657e-d096-4870-b673-98d872a4c309/volumes"
Jul 27 21:03:13.583875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:13.583839    2579 generic.go:356] "Generic (PLEG): container finished" podID="f89e5839-37b9-4d56-993c-303eddd9550c" containerID="3a83437027f3c88121d66e814512acd639ccd676a813c0669f073d8563b96681" exitCode=0
Jul 27 21:03:13.584266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:13.583886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t" event={"ID":"f89e5839-37b9-4d56-993c-303eddd9550c","Type":"ContainerDied","Data":"3a83437027f3c88121d66e814512acd639ccd676a813c0669f073d8563b96681"}
Jul 27 21:03:13.584266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:13.584262    2579 scope.go:117] "RemoveContainer" containerID="3a83437027f3c88121d66e814512acd639ccd676a813c0669f073d8563b96681"
Jul 27 21:03:14.593865 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:14.593832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t" event={"ID":"f89e5839-37b9-4d56-993c-303eddd9550c","Type":"ContainerStarted","Data":"5e9e3671e8e5fec0ed900c3ebd0e4fc2a1eb51f20ec016adf437fcfb6f6c7810"}
Jul 27 21:03:18.614159 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:18.614115    2579 generic.go:356] "Generic (PLEG): container finished" podID="0e011435-9274-419a-afec-edfa583527e7" containerID="a676d4d3a1cb0c3583061ffff8ba28ab16f0d2fef2df4dd8986ae82eae4ef391" exitCode=0
Jul 27 21:03:18.614534 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:18.614190    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dfvgc" event={"ID":"0e011435-9274-419a-afec-edfa583527e7","Type":"ContainerDied","Data":"a676d4d3a1cb0c3583061ffff8ba28ab16f0d2fef2df4dd8986ae82eae4ef391"}
Jul 27 21:03:18.614534 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:18.614532    2579 scope.go:117] "RemoveContainer" containerID="a676d4d3a1cb0c3583061ffff8ba28ab16f0d2fef2df4dd8986ae82eae4ef391"
Jul 27 21:03:19.620472 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:19.620440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dfvgc" event={"ID":"0e011435-9274-419a-afec-edfa583527e7","Type":"ContainerStarted","Data":"28c8b6c5e99ec9b029e8426829d8c4517c1e38996a708e06f147ee2187451e73"}
Jul 27 21:03:20.523986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:20.523949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:20.630447 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:20.630413    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:47.353914 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:47.353870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 21:03:47.356304 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:47.356276    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fecdeae-440a-44c5-a4b1-8ce9d02bf70b-metrics-certs\") pod \"network-metrics-daemon-6j54f\" (UID: \"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b\") " pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 21:03:47.587580 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:47.587545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cxsx8\""
Jul 27 21:03:47.595588 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:47.595567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j54f"
Jul 27 21:03:47.725292 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:47.725252    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6j54f"]
Jul 27 21:03:47.727452 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:03:47.727425    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fecdeae_440a_44c5_a4b1_8ce9d02bf70b.slice/crio-72f70bc387d3ada7b9691bcd5901bb430f2008b1b13d16d3317c01f6ec8f6c8f WatchSource:0}: Error finding container 72f70bc387d3ada7b9691bcd5901bb430f2008b1b13d16d3317c01f6ec8f6c8f: Status 404 returned error can't find the container with id 72f70bc387d3ada7b9691bcd5901bb430f2008b1b13d16d3317c01f6ec8f6c8f
Jul 27 21:03:47.733937 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:47.733912    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6j54f" event={"ID":"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b","Type":"ContainerStarted","Data":"72f70bc387d3ada7b9691bcd5901bb430f2008b1b13d16d3317c01f6ec8f6c8f"}
Jul 27 21:03:48.740668 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:48.740626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6j54f" event={"ID":"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b","Type":"ContainerStarted","Data":"35a34b2297086c264cd7803223559b7300199b23062b2037813e600a45973875"}
Jul 27 21:03:49.398489 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:49.398451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:49.746527 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:49.746441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6j54f" event={"ID":"6fecdeae-440a-44c5-a4b1-8ce9d02bf70b","Type":"ContainerStarted","Data":"b3933a9d2f92642907cfa9a048bf44f12c69ad9fec6110b11caf4398caca68e9"}
Jul 27 21:03:49.764043 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:49.764001    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6j54f" podStartSLOduration=374.868646738 podStartE2EDuration="6m15.763986809s" totalImagesPullingTime="895.340071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:49.763366565 +0000 UTC m=+375.923756945" watchObservedRunningTime="2026-07-27 21:03:49.763986809 +0000 UTC m=+375.924377191"
Jul 27 21:03:49.773902 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:49.773875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:49.895318 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:49.895282    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:49.956198 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:49.956169    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:50.453269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.453239    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:03:50.453499 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.453477    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="alertmanager" containerID="cri-o://a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8" gracePeriod=120
Jul 27 21:03:50.453565 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.453545    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-metric" containerID="cri-o://b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8" gracePeriod=120
Jul 27 21:03:50.453651 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.453631    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy" containerID="cri-o://56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f" gracePeriod=120
Jul 27 21:03:50.453714 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.453648    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="config-reloader" containerID="cri-o://28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362" gracePeriod=120
Jul 27 21:03:50.453714 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.453592    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-web" containerID="cri-o://fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2" gracePeriod=120
Jul 27 21:03:50.453821 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.453677    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="prom-label-proxy" containerID="cri-o://bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5" gracePeriod=120
Jul 27 21:03:50.753258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753184    2579 generic.go:356] "Generic (PLEG): container finished" podID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerID="bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5" exitCode=0
Jul 27 21:03:50.753258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753208    2579 generic.go:356] "Generic (PLEG): container finished" podID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerID="56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f" exitCode=0
Jul 27 21:03:50.753258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753218    2579 generic.go:356] "Generic (PLEG): container finished" podID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerID="28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362" exitCode=0
Jul 27 21:03:50.753258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753225    2579 generic.go:356] "Generic (PLEG): container finished" podID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerID="a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8" exitCode=0
Jul 27 21:03:50.753258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"}
Jul 27 21:03:50.753740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"}
Jul 27 21:03:50.753740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753364    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"}
Jul 27 21:03:50.753740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:50.753403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"}
Jul 27 21:03:51.626140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.626103    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:51.696575 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.696551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:51.730090 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.729950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:51.761319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.761288    2579 generic.go:356] "Generic (PLEG): container finished" podID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerID="b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8" exitCode=0
Jul 27 21:03:51.761319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.761316    2579 generic.go:356] "Generic (PLEG): container finished" podID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerID="fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2" exitCode=0
Jul 27 21:03:51.761730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.761342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"}
Jul 27 21:03:51.761730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.761422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"}
Jul 27 21:03:51.761730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.761443    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:51.761730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.761468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efa42659-1f1f-474b-b4e6-01e5a410038d","Type":"ContainerDied","Data":"cc803a8300bd200d86b4d973648b7e5d8c30702fb023c644a4d327a6a710dc6d"}
Jul 27 21:03:51.761730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.761448    2579 scope.go:117] "RemoveContainer" containerID="bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"
Jul 27 21:03:51.769686 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.769670    2579 scope.go:117] "RemoveContainer" containerID="b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"
Jul 27 21:03:51.777323 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.777306    2579 scope.go:117] "RemoveContainer" containerID="56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"
Jul 27 21:03:51.783984 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.783969    2579 scope.go:117] "RemoveContainer" containerID="fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"
Jul 27 21:03:51.790527 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790508    2579 scope.go:117] "RemoveContainer" containerID="28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"
Jul 27 21:03:51.790775 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790755    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-main-db\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.790855 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790783    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.790855 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790815    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82q8n\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-kube-api-access-82q8n\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.790855 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790844    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790877    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-metrics-client-ca\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790911    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-config-out\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790935    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-cluster-tls-config\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.790981    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.791011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.791040    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.791084    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.791113    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:51.791129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.791121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791586 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.791149    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle\") pod \"efa42659-1f1f-474b-b4e6-01e5a410038d\" (UID: \"efa42659-1f1f-474b-b4e6-01e5a410038d\") "
Jul 27 21:03:51.791586 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.791440    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-main-db\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.792244 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.792218    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:51.792720 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.792694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:51.794162 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.794126    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:51.794734 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.794713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:51.795125 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.795099    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume" (OuterVolumeSpecName: "config-volume") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:51.795213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.795143    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-config-out" (OuterVolumeSpecName: "config-out") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:51.795408 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.795383    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-kube-api-access-82q8n" (OuterVolumeSpecName: "kube-api-access-82q8n") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "kube-api-access-82q8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:51.795581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.795557    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:51.796042 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.796012    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:51.796829 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.796805    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:51.799731 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.799659    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:51.806165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.806138    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config" (OuterVolumeSpecName: "web-config") pod "efa42659-1f1f-474b-b4e6-01e5a410038d" (UID: "efa42659-1f1f-474b-b4e6-01e5a410038d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:51.807501 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.807482    2579 scope.go:117] "RemoveContainer" containerID="a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"
Jul 27 21:03:51.814591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.814574    2579 scope.go:117] "RemoveContainer" containerID="c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61"
Jul 27 21:03:51.821793 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.821777    2579 scope.go:117] "RemoveContainer" containerID="bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"
Jul 27 21:03:51.822086 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:51.822067    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5\": container with ID starting with bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5 not found: ID does not exist" containerID="bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"
Jul 27 21:03:51.822149 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822093    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"} err="failed to get container status \"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5\": rpc error: code = NotFound desc = could not find container \"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5\": container with ID starting with bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5 not found: ID does not exist"
Jul 27 21:03:51.822149 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822119    2579 scope.go:117] "RemoveContainer" containerID="b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"
Jul 27 21:03:51.822374 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:51.822357    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8\": container with ID starting with b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8 not found: ID does not exist" containerID="b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"
Jul 27 21:03:51.822420 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822380    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"} err="failed to get container status \"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8\": rpc error: code = NotFound desc = could not find container \"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8\": container with ID starting with b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8 not found: ID does not exist"
Jul 27 21:03:51.822420 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822406    2579 scope.go:117] "RemoveContainer" containerID="56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"
Jul 27 21:03:51.822697 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:51.822673    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f\": container with ID starting with 56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f not found: ID does not exist" containerID="56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"
Jul 27 21:03:51.822758 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822702    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"} err="failed to get container status \"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f\": rpc error: code = NotFound desc = could not find container \"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f\": container with ID starting with 56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f not found: ID does not exist"
Jul 27 21:03:51.822758 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822716    2579 scope.go:117] "RemoveContainer" containerID="fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"
Jul 27 21:03:51.822971 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:51.822949    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2\": container with ID starting with fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2 not found: ID does not exist" containerID="fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"
Jul 27 21:03:51.823010 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822975    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"} err="failed to get container status \"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2\": rpc error: code = NotFound desc = could not find container \"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2\": container with ID starting with fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2 not found: ID does not exist"
Jul 27 21:03:51.823010 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.822989    2579 scope.go:117] "RemoveContainer" containerID="28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"
Jul 27 21:03:51.823244 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:51.823228    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362\": container with ID starting with 28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362 not found: ID does not exist" containerID="28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"
Jul 27 21:03:51.823295 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823247    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"} err="failed to get container status \"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362\": rpc error: code = NotFound desc = could not find container \"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362\": container with ID starting with 28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362 not found: ID does not exist"
Jul 27 21:03:51.823295 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823265    2579 scope.go:117] "RemoveContainer" containerID="a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"
Jul 27 21:03:51.823509 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:51.823488    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8\": container with ID starting with a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8 not found: ID does not exist" containerID="a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"
Jul 27 21:03:51.823551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823512    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"} err="failed to get container status \"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8\": rpc error: code = NotFound desc = could not find container \"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8\": container with ID starting with a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8 not found: ID does not exist"
Jul 27 21:03:51.823551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823526    2579 scope.go:117] "RemoveContainer" containerID="c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61"
Jul 27 21:03:51.823758 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:03:51.823738    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61\": container with ID starting with c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61 not found: ID does not exist" containerID="c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61"
Jul 27 21:03:51.823802 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823763    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61"} err="failed to get container status \"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61\": rpc error: code = NotFound desc = could not find container \"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61\": container with ID starting with c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61 not found: ID does not exist"
Jul 27 21:03:51.823802 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823778    2579 scope.go:117] "RemoveContainer" containerID="bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"
Jul 27 21:03:51.823994 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823976    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5"} err="failed to get container status \"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5\": rpc error: code = NotFound desc = could not find container \"bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5\": container with ID starting with bded049e61e45fd78cd5147bf7bc024af043797f05c7536d952a97fc53837bb5 not found: ID does not exist"
Jul 27 21:03:51.824047 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.823994    2579 scope.go:117] "RemoveContainer" containerID="b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"
Jul 27 21:03:51.824211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824195    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8"} err="failed to get container status \"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8\": rpc error: code = NotFound desc = could not find container \"b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8\": container with ID starting with b6a8c0de14d342fc59622826132669d4ca71b37baf9f9cb29f5a87bfbf41e2f8 not found: ID does not exist"
Jul 27 21:03:51.824252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824212    2579 scope.go:117] "RemoveContainer" containerID="56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"
Jul 27 21:03:51.824416 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824399    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f"} err="failed to get container status \"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f\": rpc error: code = NotFound desc = could not find container \"56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f\": container with ID starting with 56d00e45980d0be15cf0283d646b2a771d33ca58e542be2af5e2ef12346b310f not found: ID does not exist"
Jul 27 21:03:51.824475 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824418    2579 scope.go:117] "RemoveContainer" containerID="fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"
Jul 27 21:03:51.824636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824620    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2"} err="failed to get container status \"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2\": rpc error: code = NotFound desc = could not find container \"fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2\": container with ID starting with fba0c36d792e2cfed6628d2d67bcf693c38f849132f831e3e1381f06383a10e2 not found: ID does not exist"
Jul 27 21:03:51.824691 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824636    2579 scope.go:117] "RemoveContainer" containerID="28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"
Jul 27 21:03:51.824828 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824808    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362"} err="failed to get container status \"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362\": rpc error: code = NotFound desc = could not find container \"28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362\": container with ID starting with 28c8a5cb0304b8e30fa839fc82e23dd4176ecd5ecf8dc8adcd8bf5deaedc5362 not found: ID does not exist"
Jul 27 21:03:51.824869 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.824829    2579 scope.go:117] "RemoveContainer" containerID="a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"
Jul 27 21:03:51.825026 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.825007    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8"} err="failed to get container status \"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8\": rpc error: code = NotFound desc = could not find container \"a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8\": container with ID starting with a98d889a3d5bac7c24612b86d9e79da88c3b7f2fc77091b72718acdad26e17a8 not found: ID does not exist"
Jul 27 21:03:51.825086 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.825027    2579 scope.go:117] "RemoveContainer" containerID="c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61"
Jul 27 21:03:51.825224 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.825208    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61"} err="failed to get container status \"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61\": rpc error: code = NotFound desc = could not find container \"c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61\": container with ID starting with c2185352ad50b1939b744bbecdbf790ae39682708870a18f00fc5340a886fd61 not found: ID does not exist"
Jul 27 21:03:51.892790 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892768    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892790 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892791    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82q8n\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-kube-api-access-82q8n\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892800    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-main-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892811    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-metrics-client-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892822    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa42659-1f1f-474b-b4e6-01e5a410038d-config-out\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892830    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-cluster-tls-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892838    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892846    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-web-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892854    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892862    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa42659-1f1f-474b-b4e6-01e5a410038d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892870    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa42659-1f1f-474b-b4e6-01e5a410038d-tls-assets\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:51.892908 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:51.892878    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa42659-1f1f-474b-b4e6-01e5a410038d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:03:52.085361 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.085334    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:03:52.088947 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.088926    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:03:52.116121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116092    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:03:52.116423 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116408    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7f657e-d096-4870-b673-98d872a4c309" containerName="registry"
Jul 27 21:03:52.116498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116428    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7f657e-d096-4870-b673-98d872a4c309" containerName="registry"
Jul 27 21:03:52.116498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116444    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="config-reloader"
Jul 27 21:03:52.116498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116454    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="config-reloader"
Jul 27 21:03:52.116498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116467    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-web"
Jul 27 21:03:52.116498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116476    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-web"
Jul 27 21:03:52.116498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116487    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-metric"
Jul 27 21:03:52.116498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-metric"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116506    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff17d81e-4360-4b1d-ba96-94ca5aa5e695" containerName="console"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116514    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff17d81e-4360-4b1d-ba96-94ca5aa5e695" containerName="console"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116526    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="alertmanager"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116534    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="alertmanager"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116543    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="prom-label-proxy"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116552    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="prom-label-proxy"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116567    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116576    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116622    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="init-config-reloader"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116632    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="init-config-reloader"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116726    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="prom-label-proxy"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116741    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7f657e-d096-4870-b673-98d872a4c309" containerName="registry"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116749    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="config-reloader"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116758    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="alertmanager"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116768    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116777    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff17d81e-4360-4b1d-ba96-94ca5aa5e695" containerName="console"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116787    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-metric"
Jul 27 21:03:52.116858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.116795    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" containerName="kube-rbac-proxy-web"
Jul 27 21:03:52.120773 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.120756    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.123379 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123356    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 21:03:52.123483 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123391    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 21:03:52.123483 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 21:03:52.123483 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123391    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 21:03:52.123644 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123592    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 21:03:52.123703 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123637    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 21:03:52.123750 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123736    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 21:03:52.123853 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 21:03:52.123917 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.123870    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bqtfv\""
Jul 27 21:03:52.133559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.133538    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 21:03:52.136968 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.136948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:03:52.195969 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.195938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196089 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.195977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1161446-43c4-4c64-9bb7-d7b10187a816-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196089 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-web-config\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196089 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196089 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1161446-43c4-4c64-9bb7-d7b10187a816-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1161446-43c4-4c64-9bb7-d7b10187a816-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9qn\" (UniqueName: \"kubernetes.io/projected/a1161446-43c4-4c64-9bb7-d7b10187a816-kube-api-access-xf9qn\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1161446-43c4-4c64-9bb7-d7b10187a816-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.196427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.196340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1161446-43c4-4c64-9bb7-d7b10187a816-config-out\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1161446-43c4-4c64-9bb7-d7b10187a816-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9qn\" (UniqueName: \"kubernetes.io/projected/a1161446-43c4-4c64-9bb7-d7b10187a816-kube-api-access-xf9qn\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1161446-43c4-4c64-9bb7-d7b10187a816-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1161446-43c4-4c64-9bb7-d7b10187a816-config-out\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1161446-43c4-4c64-9bb7-d7b10187a816-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-web-config\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297984 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297984 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1161446-43c4-4c64-9bb7-d7b10187a816-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.297984 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.297761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1161446-43c4-4c64-9bb7-d7b10187a816-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.298549 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.298486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1161446-43c4-4c64-9bb7-d7b10187a816-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.298800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.298774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1161446-43c4-4c64-9bb7-d7b10187a816-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.300550 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.300522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1161446-43c4-4c64-9bb7-d7b10187a816-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.300687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.300663    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.300865 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.300837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.300949 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.300880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.300949 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.300921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-web-config\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.301176 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.301155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.301356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.301339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.301579 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.301563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1161446-43c4-4c64-9bb7-d7b10187a816-config-out\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.302551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.302532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1161446-43c4-4c64-9bb7-d7b10187a816-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.305868 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.305849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9qn\" (UniqueName: \"kubernetes.io/projected/a1161446-43c4-4c64-9bb7-d7b10187a816-kube-api-access-xf9qn\") pod \"alertmanager-main-0\" (UID: \"a1161446-43c4-4c64-9bb7-d7b10187a816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.388889 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.388826    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa42659-1f1f-474b-b4e6-01e5a410038d" path="/var/lib/kubelet/pods/efa42659-1f1f-474b-b4e6-01e5a410038d/volumes"
Jul 27 21:03:52.436156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.436135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:03:52.576738 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.576715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:03:52.578794 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:03:52.578766    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1161446_43c4_4c64_9bb7_d7b10187a816.slice/crio-51f57dc162effd3651cb52032abcba4ea0803b1181ef673eb4fbabe1472a7a6b WatchSource:0}: Error finding container 51f57dc162effd3651cb52032abcba4ea0803b1181ef673eb4fbabe1472a7a6b: Status 404 returned error can't find the container with id 51f57dc162effd3651cb52032abcba4ea0803b1181ef673eb4fbabe1472a7a6b
Jul 27 21:03:52.766512 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.766478    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1161446-43c4-4c64-9bb7-d7b10187a816" containerID="7d32bdbf2e3ab4fe81c1efc280d17eaff6b004aff4ff1e5a71b33080dfd23213" exitCode=0
Jul 27 21:03:52.766875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.766574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerDied","Data":"7d32bdbf2e3ab4fe81c1efc280d17eaff6b004aff4ff1e5a71b33080dfd23213"}
Jul 27 21:03:52.766875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:52.766668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerStarted","Data":"51f57dc162effd3651cb52032abcba4ea0803b1181ef673eb4fbabe1472a7a6b"}
Jul 27 21:03:53.580537 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.580506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:53.640710 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.640676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:53.775559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.775526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerStarted","Data":"3bea3f849f7f243796b6f257f7ecf494971635c2607ea589981989710efe43ed"}
Jul 27 21:03:53.775945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.775634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerStarted","Data":"bc4a03a5d3618b9374cfaa9fef50458de15f9440fc2f56559e3403ce74f56b45"}
Jul 27 21:03:53.775945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.775680    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerStarted","Data":"090ad1137e0197ddbd08fd34d14325d715e514b3b39dfd7f97dcfc93d48859c4"}
Jul 27 21:03:53.775945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.775719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerStarted","Data":"e222f109e737a2b1ac7ab5eb7e531fb512e7d91fa9c692d85a2918bf5b56b929"}
Jul 27 21:03:53.775945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.775754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerStarted","Data":"9def13538c7471401c0eeeead3a430861e4afb1ef6bd43ba55f72c744312bdd2"}
Jul 27 21:03:53.775945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.775790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1161446-43c4-4c64-9bb7-d7b10187a816","Type":"ContainerStarted","Data":"a48da0fc2489b41462daf41725923309e7fec5ce31f572025173364150c65cca"}
Jul 27 21:03:53.805778 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:53.805668    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.788416378 podStartE2EDuration="1.805649995s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.233617ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:53.803678048 +0000 UTC m=+379.964068429" watchObservedRunningTime="2026-07-27 21:03:53.805649995 +0000 UTC m=+379.966040354"
Jul 27 21:03:54.475296 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.475262    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-698669868-tcvwl"]
Jul 27 21:03:54.478277 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.478257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.480716 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.480688    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 21:03:54.480904 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.480885    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kcs2r\""
Jul 27 21:03:54.481006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.480916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 21:03:54.481006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.480885    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 21:03:54.481128 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.481028    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 21:03:54.481247 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.481229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 21:03:54.485891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.485865    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 21:03:54.494211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.494191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-698669868-tcvwl"]
Jul 27 21:03:54.617476 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.617678 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.617678 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjrtx\" (UniqueName: \"kubernetes.io/projected/be34041a-bf56-43f2-a923-c210f1273cef-kube-api-access-mjrtx\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.617678 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-metrics-client-ca\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.617678 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-federate-client-tls\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.617826 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-serving-certs-ca-bundle\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.617826 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-secret-telemeter-client\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.617826 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.617755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-telemeter-client-tls\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.718894 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.718854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-serving-certs-ca-bundle\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.718911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-secret-telemeter-client\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.718941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-telemeter-client-tls\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.718983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.719018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.719140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjrtx\" (UniqueName: \"kubernetes.io/projected/be34041a-bf56-43f2-a923-c210f1273cef-kube-api-access-mjrtx\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.719222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-metrics-client-ca\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.719260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-federate-client-tls\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719743 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.719711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-serving-certs-ca-bundle\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.719915 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.719886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-metrics-client-ca\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.720094 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.719969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be34041a-bf56-43f2-a923-c210f1273cef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.721861 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.721838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.721997 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.721976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-secret-telemeter-client\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.722170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.722154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-federate-client-tls\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.722232 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.722159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be34041a-bf56-43f2-a923-c210f1273cef-telemeter-client-tls\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.726838 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.726787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjrtx\" (UniqueName: \"kubernetes.io/projected/be34041a-bf56-43f2-a923-c210f1273cef-kube-api-access-mjrtx\") pod \"telemeter-client-698669868-tcvwl\" (UID: \"be34041a-bf56-43f2-a923-c210f1273cef\") " pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.789009 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.788980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-698669868-tcvwl"
Jul 27 21:03:54.924660 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:54.924641    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-698669868-tcvwl"]
Jul 27 21:03:54.926874 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:03:54.926843    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe34041a_bf56_43f2_a923_c210f1273cef.slice/crio-7dd8551c45e70bc12a17e3c10f0a8c76c47091bd661bc9d1a8967dc5ef561de8 WatchSource:0}: Error finding container 7dd8551c45e70bc12a17e3c10f0a8c76c47091bd661bc9d1a8967dc5ef561de8: Status 404 returned error can't find the container with id 7dd8551c45e70bc12a17e3c10f0a8c76c47091bd661bc9d1a8967dc5ef561de8
Jul 27 21:03:55.786064 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:55.786024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698669868-tcvwl" event={"ID":"be34041a-bf56-43f2-a923-c210f1273cef","Type":"ContainerStarted","Data":"7dd8551c45e70bc12a17e3c10f0a8c76c47091bd661bc9d1a8967dc5ef561de8"}
Jul 27 21:03:57.797572 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:57.797536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698669868-tcvwl" event={"ID":"be34041a-bf56-43f2-a923-c210f1273cef","Type":"ContainerStarted","Data":"fcee56d1b8c474a699f787c7a91c3f2e83eb8beee6ec2f10866253799d7ccfa9"}
Jul 27 21:03:57.797956 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:57.797633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698669868-tcvwl" event={"ID":"be34041a-bf56-43f2-a923-c210f1273cef","Type":"ContainerStarted","Data":"7847791e66a912a4116adc0deee8e5213cb78584bfe33e91df4c86d44fcf9c8a"}
Jul 27 21:03:57.797956 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:57.797654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698669868-tcvwl" event={"ID":"be34041a-bf56-43f2-a923-c210f1273cef","Type":"ContainerStarted","Data":"130f93f0a41b0ac3ecd914f9cc18f93cc2d345a4dab694d2499b10f6fc0426bf"}
Jul 27 21:03:57.819322 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:57.819277    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-698669868-tcvwl" podStartSLOduration=1.780763318 podStartE2EDuration="3.819261628s" totalImagesPullingTime="2.03849831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:57.818022067 +0000 UTC m=+383.978412425" watchObservedRunningTime="2026-07-27 21:03:57.819261628 +0000 UTC m=+383.979651987"
Jul 27 21:03:58.615457 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.615426    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59fcbbc584-c6lfk"]
Jul 27 21:03:58.619554 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.619530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.634890 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.634867    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fcbbc584-c6lfk"]
Jul 27 21:03:58.677248 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.677214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:58.734320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.734283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:58.755252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.755225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-console-config\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.755348 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.755261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-trusted-ca-bundle\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.755348 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.755289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-service-ca\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.755348 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.755338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-oauth-serving-cert\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.755472 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.755361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-serving-cert\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.755472 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.755397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-oauth-config\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.755472 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.755420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhd4c\" (UniqueName: \"kubernetes.io/projected/226015f3-9b11-493a-bb70-aa9591aefdd1-kube-api-access-lhd4c\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-oauth-serving-cert\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-serving-cert\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-oauth-config\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhd4c\" (UniqueName: \"kubernetes.io/projected/226015f3-9b11-493a-bb70-aa9591aefdd1-kube-api-access-lhd4c\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-console-config\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-trusted-ca-bundle\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-service-ca\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.856978 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.856953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-oauth-serving-cert\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.857056 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.857020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-console-config\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.857194 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.857169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-trusted-ca-bundle\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.857254 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.857207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-service-ca\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.858803 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.858779    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-oauth-config\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.858891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.858866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-serving-cert\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.868961 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.868916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhd4c\" (UniqueName: \"kubernetes.io/projected/226015f3-9b11-493a-bb70-aa9591aefdd1-kube-api-access-lhd4c\") pod \"console-59fcbbc584-c6lfk\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") " pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:58.931144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:58.931117    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:03:59.063237 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:59.063213    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fcbbc584-c6lfk"]
Jul 27 21:03:59.065311 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:03:59.065283    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226015f3_9b11_493a_bb70_aa9591aefdd1.slice/crio-b04d3f58ba49359f84a8a1d4568aedaba7d6d207f927d6b3b39eecd2e4c06423 WatchSource:0}: Error finding container b04d3f58ba49359f84a8a1d4568aedaba7d6d207f927d6b3b39eecd2e4c06423: Status 404 returned error can't find the container with id b04d3f58ba49359f84a8a1d4568aedaba7d6d207f927d6b3b39eecd2e4c06423
Jul 27 21:03:59.807190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:59.807160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fcbbc584-c6lfk" event={"ID":"226015f3-9b11-493a-bb70-aa9591aefdd1","Type":"ContainerStarted","Data":"df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54"}
Jul 27 21:03:59.807346 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:59.807205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fcbbc584-c6lfk" event={"ID":"226015f3-9b11-493a-bb70-aa9591aefdd1","Type":"ContainerStarted","Data":"b04d3f58ba49359f84a8a1d4568aedaba7d6d207f927d6b3b39eecd2e4c06423"}
Jul 27 21:03:59.824433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:03:59.824386    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59fcbbc584-c6lfk" podStartSLOduration=1.8243710260000001 podStartE2EDuration="1.824371026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:59.823760566 +0000 UTC m=+385.984150927" watchObservedRunningTime="2026-07-27 21:03:59.824371026 +0000 UTC m=+385.984761445"
Jul 27 21:04:01.605466 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:01.605433    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:08.932009 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:08.931978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:04:08.932342 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:08.932057    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:04:08.936748 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:08.936729    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:04:09.852896 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:09.852864    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:04:09.900182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:09.900155    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc5897c7b-xlktv"]
Jul 27 21:04:10.052438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:10.052407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:10.154032 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:10.153949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:30.568978 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:30.568939    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:34.187013 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:34.186980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:34.925171 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:34.925137    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cc5897c7b-xlktv" podUID="aeb2eccc-4405-4198-809f-c24df1cd39bc" containerName="console" containerID="cri-o://1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34" gracePeriod=15
Jul 27 21:04:35.171239 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.171217    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:04:35.246591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.246511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-oauth-config\") pod \"aeb2eccc-4405-4198-809f-c24df1cd39bc\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") "
Jul 27 21:04:35.246591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.246546    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-serving-cert\") pod \"aeb2eccc-4405-4198-809f-c24df1cd39bc\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") "
Jul 27 21:04:35.246591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.246575    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-trusted-ca-bundle\") pod \"aeb2eccc-4405-4198-809f-c24df1cd39bc\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") "
Jul 27 21:04:35.247144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.246629    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-service-ca\") pod \"aeb2eccc-4405-4198-809f-c24df1cd39bc\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") "
Jul 27 21:04:35.247144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.246672    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-config\") pod \"aeb2eccc-4405-4198-809f-c24df1cd39bc\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") "
Jul 27 21:04:35.247144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.246737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-oauth-serving-cert\") pod \"aeb2eccc-4405-4198-809f-c24df1cd39bc\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") "
Jul 27 21:04:35.247144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.246762    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r99lb\" (UniqueName: \"kubernetes.io/projected/aeb2eccc-4405-4198-809f-c24df1cd39bc-kube-api-access-r99lb\") pod \"aeb2eccc-4405-4198-809f-c24df1cd39bc\" (UID: \"aeb2eccc-4405-4198-809f-c24df1cd39bc\") "
Jul 27 21:04:35.247144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.247130    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-config" (OuterVolumeSpecName: "console-config") pod "aeb2eccc-4405-4198-809f-c24df1cd39bc" (UID: "aeb2eccc-4405-4198-809f-c24df1cd39bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:35.247374 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.247148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "aeb2eccc-4405-4198-809f-c24df1cd39bc" (UID: "aeb2eccc-4405-4198-809f-c24df1cd39bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:35.247374 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.247180    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aeb2eccc-4405-4198-809f-c24df1cd39bc" (UID: "aeb2eccc-4405-4198-809f-c24df1cd39bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:35.247374 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.247184    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aeb2eccc-4405-4198-809f-c24df1cd39bc" (UID: "aeb2eccc-4405-4198-809f-c24df1cd39bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:35.248943 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.248919    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aeb2eccc-4405-4198-809f-c24df1cd39bc" (UID: "aeb2eccc-4405-4198-809f-c24df1cd39bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:04:35.249020 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.248942    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aeb2eccc-4405-4198-809f-c24df1cd39bc" (UID: "aeb2eccc-4405-4198-809f-c24df1cd39bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:04:35.249020 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.248989    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb2eccc-4405-4198-809f-c24df1cd39bc-kube-api-access-r99lb" (OuterVolumeSpecName: "kube-api-access-r99lb") pod "aeb2eccc-4405-4198-809f-c24df1cd39bc" (UID: "aeb2eccc-4405-4198-809f-c24df1cd39bc"). InnerVolumeSpecName "kube-api-access-r99lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:35.347576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.347549    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:04:35.347576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.347573    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-trusted-ca-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:04:35.347759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.347583    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:04:35.347759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.347594    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:04:35.347759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.347622    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb2eccc-4405-4198-809f-c24df1cd39bc-oauth-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:04:35.347759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.347631    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r99lb\" (UniqueName: \"kubernetes.io/projected/aeb2eccc-4405-4198-809f-c24df1cd39bc-kube-api-access-r99lb\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:04:35.347759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.347640    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb2eccc-4405-4198-809f-c24df1cd39bc-console-oauth-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:04:35.951854 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.951816    2579 generic.go:356] "Generic (PLEG): container finished" podID="aeb2eccc-4405-4198-809f-c24df1cd39bc" containerID="1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34" exitCode=0
Jul 27 21:04:35.952045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.951877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc5897c7b-xlktv" event={"ID":"aeb2eccc-4405-4198-809f-c24df1cd39bc","Type":"ContainerDied","Data":"1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34"}
Jul 27 21:04:35.952045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.951880    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc5897c7b-xlktv"
Jul 27 21:04:35.952045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.951919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc5897c7b-xlktv" event={"ID":"aeb2eccc-4405-4198-809f-c24df1cd39bc","Type":"ContainerDied","Data":"e6c692c888980fab57116c57d7bd8e581a97d009e87ed23d1bdd17db9686eb86"}
Jul 27 21:04:35.952045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.951938    2579 scope.go:117] "RemoveContainer" containerID="1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34"
Jul 27 21:04:35.961131 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.961109    2579 scope.go:117] "RemoveContainer" containerID="1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34"
Jul 27 21:04:35.961387 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:04:35.961367    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34\": container with ID starting with 1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34 not found: ID does not exist" containerID="1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34"
Jul 27 21:04:35.961424 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.961396    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34"} err="failed to get container status \"1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34\": rpc error: code = NotFound desc = could not find container \"1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34\": container with ID starting with 1843340bb9d8bfa9c4a76c9a460fe8de907c97e28f66cbf308a953a6b5305b34 not found: ID does not exist"
Jul 27 21:04:35.973629 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.973574    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc5897c7b-xlktv"]
Jul 27 21:04:35.975505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:35.975487    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cc5897c7b-xlktv"]
Jul 27 21:04:36.388722 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:36.388695    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeb2eccc-4405-4198-809f-c24df1cd39bc" path="/var/lib/kubelet/pods/aeb2eccc-4405-4198-809f-c24df1cd39bc/volumes"
Jul 27 21:04:49.435991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:49.435951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:49.489995 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:04:49.489960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:02.191546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:02.191454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:04.617687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:04.617630    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:04.670813 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:04.670783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:05.884413 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.884381    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-575df745c9-tgxq6"]
Jul 27 21:05:05.884808 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.884793    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb2eccc-4405-4198-809f-c24df1cd39bc" containerName="console"
Jul 27 21:05:05.884852 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.884810    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb2eccc-4405-4198-809f-c24df1cd39bc" containerName="console"
Jul 27 21:05:05.884886 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.884861    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb2eccc-4405-4198-809f-c24df1cd39bc" containerName="console"
Jul 27 21:05:05.888205 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.888179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:05.897767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.897741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575df745c9-tgxq6"]
Jul 27 21:05:05.939352 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.939325    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:05.992296 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:05.992267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:06.005389 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.005370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4l68\" (UniqueName: \"kubernetes.io/projected/1e325720-8990-490c-ae3f-6641f1615c68-kube-api-access-g4l68\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.005461 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.005405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-serving-cert\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.005461 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.005425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-service-ca\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.005461 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.005448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-console-config\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.005590 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.005480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-oauth-serving-cert\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.005590 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.005507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-trusted-ca-bundle\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.005721 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.005630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-oauth-config\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.106163 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-console-config\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.106323 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-oauth-serving-cert\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.106323 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-trusted-ca-bundle\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.106323 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-oauth-config\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.106323 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4l68\" (UniqueName: \"kubernetes.io/projected/1e325720-8990-490c-ae3f-6641f1615c68-kube-api-access-g4l68\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.106535 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-serving-cert\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.106535 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-service-ca\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.107015 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.106993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-console-config\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.107121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.107041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-service-ca\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.107121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.107041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-oauth-serving-cert\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.107471 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.107446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-trusted-ca-bundle\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.108903 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.108881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-serving-cert\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.109037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.109019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-oauth-config\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.113877 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.113855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4l68\" (UniqueName: \"kubernetes.io/projected/1e325720-8990-490c-ae3f-6641f1615c68-kube-api-access-g4l68\") pod \"console-575df745c9-tgxq6\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") " pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.199674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.199588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:06.332199 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:06.332168    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575df745c9-tgxq6"]
Jul 27 21:05:06.335121 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:05:06.335092    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e325720_8990_490c_ae3f_6641f1615c68.slice/crio-e2fd4c95386bc759b70e7ba6418303f3334df985e283537cb8a07b3ee8149fc2 WatchSource:0}: Error finding container e2fd4c95386bc759b70e7ba6418303f3334df985e283537cb8a07b3ee8149fc2: Status 404 returned error can't find the container with id e2fd4c95386bc759b70e7ba6418303f3334df985e283537cb8a07b3ee8149fc2
Jul 27 21:05:07.080359 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:07.080320    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575df745c9-tgxq6" event={"ID":"1e325720-8990-490c-ae3f-6641f1615c68","Type":"ContainerStarted","Data":"64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01"}
Jul 27 21:05:07.080924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:07.080379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575df745c9-tgxq6" event={"ID":"1e325720-8990-490c-ae3f-6641f1615c68","Type":"ContainerStarted","Data":"e2fd4c95386bc759b70e7ba6418303f3334df985e283537cb8a07b3ee8149fc2"}
Jul 27 21:05:07.098832 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:07.098785    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-575df745c9-tgxq6" podStartSLOduration=2.098769851 podStartE2EDuration="2.098769851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:07.096577664 +0000 UTC m=+453.256968033" watchObservedRunningTime="2026-07-27 21:05:07.098769851 +0000 UTC m=+453.259160209"
Jul 27 21:05:16.200186 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:16.200151    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:16.200558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:16.200212    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:16.205453 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:16.205426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:16.546364 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:16.546324    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:16.612106 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:16.612068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:17.125262 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:17.125236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:05:17.179135 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:17.179103    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59fcbbc584-c6lfk"]
Jul 27 21:05:17.417560 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:17.417481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:17.499368 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:17.499334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:20.493370 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:20.493332    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:20.594810 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:20.594775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:20.648377 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:20.648351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:21.314437 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:21.314401    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:30.739152 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:30.739115    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:42.200762 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.200692    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59fcbbc584-c6lfk" podUID="226015f3-9b11-493a-bb70-aa9591aefdd1" containerName="console" containerID="cri-o://df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54" gracePeriod=15
Jul 27 21:05:42.441013 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.440991    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:05:42.500887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.500819    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-oauth-serving-cert\") pod \"226015f3-9b11-493a-bb70-aa9591aefdd1\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") "
Jul 27 21:05:42.500887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.500850    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-trusted-ca-bundle\") pod \"226015f3-9b11-493a-bb70-aa9591aefdd1\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") "
Jul 27 21:05:42.500887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.500882    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-service-ca\") pod \"226015f3-9b11-493a-bb70-aa9591aefdd1\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") "
Jul 27 21:05:42.501121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.500910    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhd4c\" (UniqueName: \"kubernetes.io/projected/226015f3-9b11-493a-bb70-aa9591aefdd1-kube-api-access-lhd4c\") pod \"226015f3-9b11-493a-bb70-aa9591aefdd1\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") "
Jul 27 21:05:42.501121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.500935    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-console-config\") pod \"226015f3-9b11-493a-bb70-aa9591aefdd1\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") "
Jul 27 21:05:42.501121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.501002    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-serving-cert\") pod \"226015f3-9b11-493a-bb70-aa9591aefdd1\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") "
Jul 27 21:05:42.501121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.501024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-oauth-config\") pod \"226015f3-9b11-493a-bb70-aa9591aefdd1\" (UID: \"226015f3-9b11-493a-bb70-aa9591aefdd1\") "
Jul 27 21:05:42.501332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.501220    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "226015f3-9b11-493a-bb70-aa9591aefdd1" (UID: "226015f3-9b11-493a-bb70-aa9591aefdd1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:05:42.501332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.501264    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-service-ca" (OuterVolumeSpecName: "service-ca") pod "226015f3-9b11-493a-bb70-aa9591aefdd1" (UID: "226015f3-9b11-493a-bb70-aa9591aefdd1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:05:42.501332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.501277    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "226015f3-9b11-493a-bb70-aa9591aefdd1" (UID: "226015f3-9b11-493a-bb70-aa9591aefdd1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:05:42.501332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.501330    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-oauth-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:05:42.501516 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.501334    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-console-config" (OuterVolumeSpecName: "console-config") pod "226015f3-9b11-493a-bb70-aa9591aefdd1" (UID: "226015f3-9b11-493a-bb70-aa9591aefdd1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:05:42.503294 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.503249    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226015f3-9b11-493a-bb70-aa9591aefdd1-kube-api-access-lhd4c" (OuterVolumeSpecName: "kube-api-access-lhd4c") pod "226015f3-9b11-493a-bb70-aa9591aefdd1" (UID: "226015f3-9b11-493a-bb70-aa9591aefdd1"). InnerVolumeSpecName "kube-api-access-lhd4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:05:42.503429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.503401    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "226015f3-9b11-493a-bb70-aa9591aefdd1" (UID: "226015f3-9b11-493a-bb70-aa9591aefdd1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:05:42.503473 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.503425    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "226015f3-9b11-493a-bb70-aa9591aefdd1" (UID: "226015f3-9b11-493a-bb70-aa9591aefdd1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:05:42.601887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.601864    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-trusted-ca-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:05:42.601887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.601885    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:05:42.602028 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.601894    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhd4c\" (UniqueName: \"kubernetes.io/projected/226015f3-9b11-493a-bb70-aa9591aefdd1-kube-api-access-lhd4c\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:05:42.602028 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.601902    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226015f3-9b11-493a-bb70-aa9591aefdd1-console-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:05:42.602028 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.601910    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:05:42.602028 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:42.601918    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226015f3-9b11-493a-bb70-aa9591aefdd1-console-oauth-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:05:43.228206 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.228168    2579 generic.go:356] "Generic (PLEG): container finished" podID="226015f3-9b11-493a-bb70-aa9591aefdd1" containerID="df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54" exitCode=0
Jul 27 21:05:43.228587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.228217    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fcbbc584-c6lfk"
Jul 27 21:05:43.228587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.228257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fcbbc584-c6lfk" event={"ID":"226015f3-9b11-493a-bb70-aa9591aefdd1","Type":"ContainerDied","Data":"df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54"}
Jul 27 21:05:43.228587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.228310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fcbbc584-c6lfk" event={"ID":"226015f3-9b11-493a-bb70-aa9591aefdd1","Type":"ContainerDied","Data":"b04d3f58ba49359f84a8a1d4568aedaba7d6d207f927d6b3b39eecd2e4c06423"}
Jul 27 21:05:43.228587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.228330    2579 scope.go:117] "RemoveContainer" containerID="df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54"
Jul 27 21:05:43.237123 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.237108    2579 scope.go:117] "RemoveContainer" containerID="df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54"
Jul 27 21:05:43.237377 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:05:43.237360    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54\": container with ID starting with df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54 not found: ID does not exist" containerID="df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54"
Jul 27 21:05:43.237444 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.237386    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54"} err="failed to get container status \"df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54\": rpc error: code = NotFound desc = could not find container \"df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54\": container with ID starting with df9d762d3b127d0ff98a51d76d2b433f405d388591f943bf18324ac91f2fbe54 not found: ID does not exist"
Jul 27 21:05:43.247966 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.247939    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59fcbbc584-c6lfk"]
Jul 27 21:05:43.251058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:43.251039    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59fcbbc584-c6lfk"]
Jul 27 21:05:44.388818 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:05:44.388783    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226015f3-9b11-493a-bb70-aa9591aefdd1" path="/var/lib/kubelet/pods/226015f3-9b11-493a-bb70-aa9591aefdd1/volumes"
Jul 27 21:06:20.273561 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.273527    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:20.373307 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.373271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:20.942610 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.942563    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"]
Jul 27 21:06:20.942905 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.942892    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226015f3-9b11-493a-bb70-aa9591aefdd1" containerName="console"
Jul 27 21:06:20.942954 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.942907    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="226015f3-9b11-493a-bb70-aa9591aefdd1" containerName="console"
Jul 27 21:06:20.942996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.942968    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="226015f3-9b11-493a-bb70-aa9591aefdd1" containerName="console"
Jul 27 21:06:20.946192 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.946177    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:20.948587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.948562    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rggvt\""
Jul 27 21:06:20.948745 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.948716    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 21:06:20.949275 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.949259    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 21:06:20.954744 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:20.954724    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"]
Jul 27 21:06:21.010164 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.010136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.010272 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.010180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78nv2\" (UniqueName: \"kubernetes.io/projected/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-kube-api-access-78nv2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.010272 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.010252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.111453 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.111418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78nv2\" (UniqueName: \"kubernetes.io/projected/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-kube-api-access-78nv2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.111551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.111474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.111551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.111503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.111825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.111810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.111878 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.111843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.119354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.119328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78nv2\" (UniqueName: \"kubernetes.io/projected/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-kube-api-access-78nv2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.256707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.256654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:21.387459 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:21.387435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"]
Jul 27 21:06:21.389789 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:06:21.389757    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc2b46d_d5bc_4cef_86fe_f6f3cbb527eb.slice/crio-c27b98c75c2e514e417006a6dca5c9348d83c205414b17cc89ceb66b6e5a53a4 WatchSource:0}: Error finding container c27b98c75c2e514e417006a6dca5c9348d83c205414b17cc89ceb66b6e5a53a4: Status 404 returned error can't find the container with id c27b98c75c2e514e417006a6dca5c9348d83c205414b17cc89ceb66b6e5a53a4
Jul 27 21:06:22.390529 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:22.390498    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w" event={"ID":"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb","Type":"ContainerStarted","Data":"c27b98c75c2e514e417006a6dca5c9348d83c205414b17cc89ceb66b6e5a53a4"}
Jul 27 21:06:28.413906 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:28.413873    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerID="222beb11b01de543007a934abf558beea719b5acb8b4947077412b4e80b50525" exitCode=0
Jul 27 21:06:28.414294 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:28.413963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w" event={"ID":"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb","Type":"ContainerDied","Data":"222beb11b01de543007a934abf558beea719b5acb8b4947077412b4e80b50525"}
Jul 27 21:06:31.427759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:31.427723    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerID="3293b91f67ebedc5d94933f9afd6484561557a4462bc7c45f74e546f91402c14" exitCode=0
Jul 27 21:06:31.428130 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:31.427801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w" event={"ID":"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb","Type":"ContainerDied","Data":"3293b91f67ebedc5d94933f9afd6484561557a4462bc7c45f74e546f91402c14"}
Jul 27 21:06:38.463927 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:38.463893    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerID="fde7d65223376aca8acabbf11794f2b171298f6bc9216ce75c5cc0ea1bdc6f2c" exitCode=0
Jul 27 21:06:38.464299 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:38.463962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w" event={"ID":"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb","Type":"ContainerDied","Data":"fde7d65223376aca8acabbf11794f2b171298f6bc9216ce75c5cc0ea1bdc6f2c"}
Jul 27 21:06:39.601705 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.601684    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:39.673540 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.673508    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-bundle\") pod \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") "
Jul 27 21:06:39.673708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.673575    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78nv2\" (UniqueName: \"kubernetes.io/projected/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-kube-api-access-78nv2\") pod \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") "
Jul 27 21:06:39.673708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.673630    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-util\") pod \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\" (UID: \"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb\") "
Jul 27 21:06:39.674231 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.674209    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-bundle" (OuterVolumeSpecName: "bundle") pod "7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" (UID: "7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:39.675899 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.675874    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-kube-api-access-78nv2" (OuterVolumeSpecName: "kube-api-access-78nv2") pod "7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" (UID: "7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb"). InnerVolumeSpecName "kube-api-access-78nv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:39.678365 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.678345    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-util" (OuterVolumeSpecName: "util") pod "7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" (UID: "7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:39.774452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.774430    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78nv2\" (UniqueName: \"kubernetes.io/projected/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-kube-api-access-78nv2\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:06:39.774452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.774451    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:06:39.774584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:39.774461    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:06:40.474561 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:40.474538    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w"
Jul 27 21:06:40.474772 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:40.474538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgm2w" event={"ID":"7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb","Type":"ContainerDied","Data":"c27b98c75c2e514e417006a6dca5c9348d83c205414b17cc89ceb66b6e5a53a4"}
Jul 27 21:06:40.474772 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:40.474647    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c27b98c75c2e514e417006a6dca5c9348d83c205414b17cc89ceb66b6e5a53a4"
Jul 27 21:06:41.736825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:41.736793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:43.086228 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.086191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:43.666799 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.666765    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"]
Jul 27 21:06:43.667093 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.667081    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerName="extract"
Jul 27 21:06:43.667140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.667095    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerName="extract"
Jul 27 21:06:43.667140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.667104    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerName="pull"
Jul 27 21:06:43.667140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.667110    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerName="pull"
Jul 27 21:06:43.667140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.667121    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerName="util"
Jul 27 21:06:43.667140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.667127    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerName="util"
Jul 27 21:06:43.667280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.667212    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc2b46d-d5bc-4cef-86fe-f6f3cbb527eb" containerName="extract"
Jul 27 21:06:43.716310 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.716282    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"]
Jul 27 21:06:43.716444 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.716371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:43.718876 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.718852    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 21:06:43.719011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.718933    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:06:43.719011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.718994    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ksm7n\""
Jul 27 21:06:43.806289 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.806265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666c4a16-957b-49e1-928c-2b16d62c50ae-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nl57c\" (UID: \"666c4a16-957b-49e1-928c-2b16d62c50ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:43.806383 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.806324    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6dqm\" (UniqueName: \"kubernetes.io/projected/666c4a16-957b-49e1-928c-2b16d62c50ae-kube-api-access-h6dqm\") pod \"cert-manager-operator-controller-manager-55c444bf86-nl57c\" (UID: \"666c4a16-957b-49e1-928c-2b16d62c50ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:43.907348 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.907325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dqm\" (UniqueName: \"kubernetes.io/projected/666c4a16-957b-49e1-928c-2b16d62c50ae-kube-api-access-h6dqm\") pod \"cert-manager-operator-controller-manager-55c444bf86-nl57c\" (UID: \"666c4a16-957b-49e1-928c-2b16d62c50ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:43.907449 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.907370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666c4a16-957b-49e1-928c-2b16d62c50ae-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nl57c\" (UID: \"666c4a16-957b-49e1-928c-2b16d62c50ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:43.907700 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.907685    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666c4a16-957b-49e1-928c-2b16d62c50ae-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nl57c\" (UID: \"666c4a16-957b-49e1-928c-2b16d62c50ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:43.921515 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:43.921463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6dqm\" (UniqueName: \"kubernetes.io/projected/666c4a16-957b-49e1-928c-2b16d62c50ae-kube-api-access-h6dqm\") pod \"cert-manager-operator-controller-manager-55c444bf86-nl57c\" (UID: \"666c4a16-957b-49e1-928c-2b16d62c50ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:44.025713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:44.025679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"
Jul 27 21:06:44.176087 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:44.176001    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c"]
Jul 27 21:06:44.180388 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:06:44.180357    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666c4a16_957b_49e1_928c_2b16d62c50ae.slice/crio-928c9b2ace73ac207d28df0846cd805872bb358e54d85aa224fbba7616cf681f WatchSource:0}: Error finding container 928c9b2ace73ac207d28df0846cd805872bb358e54d85aa224fbba7616cf681f: Status 404 returned error can't find the container with id 928c9b2ace73ac207d28df0846cd805872bb358e54d85aa224fbba7616cf681f
Jul 27 21:06:44.493467 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:44.493393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c" event={"ID":"666c4a16-957b-49e1-928c-2b16d62c50ae","Type":"ContainerStarted","Data":"928c9b2ace73ac207d28df0846cd805872bb358e54d85aa224fbba7616cf681f"}
Jul 27 21:06:45.342015 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:45.341979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:45.441668 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:45.441631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:47.366925 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:47.366885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:47.459667 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:47.459635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:47.509175 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:47.509141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c" event={"ID":"666c4a16-957b-49e1-928c-2b16d62c50ae","Type":"ContainerStarted","Data":"94a671b11a6a5b54a15bcfa3e0fca1059c7caca188da60208b975ba50db97aba"}
Jul 27 21:06:47.531190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:47.531139    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nl57c" podStartSLOduration=2.143139337 podStartE2EDuration="4.53111989s" totalImagesPullingTime="2.387980553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:47.529205595 +0000 UTC m=+553.689595956" watchObservedRunningTime="2026-07-27 21:06:47.53111989 +0000 UTC m=+553.691510250"
Jul 27 21:06:47.870378 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:47.870342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:48.003244 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.003215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:48.422263 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.422229    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"]
Jul 27 21:06:48.424754 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.424736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.427051 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.427030    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 21:06:48.427153 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.427073    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 21:06:48.427813 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.427796    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rggvt\""
Jul 27 21:06:48.437470 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.437447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"]
Jul 27 21:06:48.545820 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.545788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.546036 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.545842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm97s\" (UniqueName: \"kubernetes.io/projected/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-kube-api-access-gm97s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.546036 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.545912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.646571 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.646540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.646733 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.646584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm97s\" (UniqueName: \"kubernetes.io/projected/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-kube-api-access-gm97s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.646733 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.646642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.646894 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.646874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.646954 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.646897    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.658350 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.658323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm97s\" (UniqueName: \"kubernetes.io/projected/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-kube-api-access-gm97s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.733952 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.733890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:48.869639 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:48.869615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"]
Jul 27 21:06:48.872128 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:06:48.872100    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8c9501_8738_4e2f_bccc_bb39d7bb58ea.slice/crio-3cb72d4a3aa28a2ea39c414f44f8f3a087bf080c608d150b9f0845e1555de96a WatchSource:0}: Error finding container 3cb72d4a3aa28a2ea39c414f44f8f3a087bf080c608d150b9f0845e1555de96a: Status 404 returned error can't find the container with id 3cb72d4a3aa28a2ea39c414f44f8f3a087bf080c608d150b9f0845e1555de96a
Jul 27 21:06:49.518580 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:49.518548    2579 generic.go:356] "Generic (PLEG): container finished" podID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerID="685c7a78929ecbce34004e889ed3314968717dcc37fdf2b4784bcabad5f65f63" exitCode=0
Jul 27 21:06:49.518952 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:49.518636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm" event={"ID":"de8c9501-8738-4e2f-bccc-bb39d7bb58ea","Type":"ContainerDied","Data":"685c7a78929ecbce34004e889ed3314968717dcc37fdf2b4784bcabad5f65f63"}
Jul 27 21:06:49.518952 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:49.518684    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm" event={"ID":"de8c9501-8738-4e2f-bccc-bb39d7bb58ea","Type":"ContainerStarted","Data":"3cb72d4a3aa28a2ea39c414f44f8f3a087bf080c608d150b9f0845e1555de96a"}
Jul 27 21:06:49.565386 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:49.565348    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:49.755384 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:49.755354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:51.530611 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:51.530567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm" event={"ID":"de8c9501-8738-4e2f-bccc-bb39d7bb58ea","Type":"ContainerStarted","Data":"5fe0e68836d48e9fb37ef5e232f5a191a19a090a40cd3e86e4f9ec64a528ed6f"}
Jul 27 21:06:52.332462 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:52.332418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:52.390965 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:52.390933    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:52.537030 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:52.536995    2579 generic.go:356] "Generic (PLEG): container finished" podID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerID="5fe0e68836d48e9fb37ef5e232f5a191a19a090a40cd3e86e4f9ec64a528ed6f" exitCode=0
Jul 27 21:06:52.537396 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:52.537084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm" event={"ID":"de8c9501-8738-4e2f-bccc-bb39d7bb58ea","Type":"ContainerDied","Data":"5fe0e68836d48e9fb37ef5e232f5a191a19a090a40cd3e86e4f9ec64a528ed6f"}
Jul 27 21:06:53.543583 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:53.543551    2579 generic.go:356] "Generic (PLEG): container finished" podID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerID="0c80652e3030dc8ea179ecc980b5ec98909c8816aee7cd82004a978812ecd7b3" exitCode=0
Jul 27 21:06:53.544006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:53.543641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm" event={"ID":"de8c9501-8738-4e2f-bccc-bb39d7bb58ea","Type":"ContainerDied","Data":"0c80652e3030dc8ea179ecc980b5ec98909c8816aee7cd82004a978812ecd7b3"}
Jul 27 21:06:54.674771 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.674749    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:54.796462 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.796427    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm97s\" (UniqueName: \"kubernetes.io/projected/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-kube-api-access-gm97s\") pod \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") "
Jul 27 21:06:54.796731 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.796485    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-util\") pod \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") "
Jul 27 21:06:54.796731 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.796544    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-bundle\") pod \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\" (UID: \"de8c9501-8738-4e2f-bccc-bb39d7bb58ea\") "
Jul 27 21:06:54.796939 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.796906    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-bundle" (OuterVolumeSpecName: "bundle") pod "de8c9501-8738-4e2f-bccc-bb39d7bb58ea" (UID: "de8c9501-8738-4e2f-bccc-bb39d7bb58ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:54.798628 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.798570    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-kube-api-access-gm97s" (OuterVolumeSpecName: "kube-api-access-gm97s") pod "de8c9501-8738-4e2f-bccc-bb39d7bb58ea" (UID: "de8c9501-8738-4e2f-bccc-bb39d7bb58ea"). InnerVolumeSpecName "kube-api-access-gm97s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:54.800823 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.800805    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-util" (OuterVolumeSpecName: "util") pod "de8c9501-8738-4e2f-bccc-bb39d7bb58ea" (UID: "de8c9501-8738-4e2f-bccc-bb39d7bb58ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:54.898097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.898068    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:06:54.898097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.898098    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm97s\" (UniqueName: \"kubernetes.io/projected/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-kube-api-access-gm97s\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:06:54.898233 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:54.898111    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de8c9501-8738-4e2f-bccc-bb39d7bb58ea-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:06:55.342018 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.341982    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"]
Jul 27 21:06:55.342388 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.342370    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerName="util"
Jul 27 21:06:55.342477 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.342391    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerName="util"
Jul 27 21:06:55.342477 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.342417    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerName="pull"
Jul 27 21:06:55.342477 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.342426    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerName="pull"
Jul 27 21:06:55.342477 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.342440    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerName="extract"
Jul 27 21:06:55.342477 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.342449    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerName="extract"
Jul 27 21:06:55.342760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.342535    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="de8c9501-8738-4e2f-bccc-bb39d7bb58ea" containerName="extract"
Jul 27 21:06:55.344767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.344747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.346903 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.346875    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 21:06:55.347024 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.346912    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 21:06:55.347630 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.347614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2blzt\""
Jul 27 21:06:55.354213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.354193    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"]
Jul 27 21:06:55.503441 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.503411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bb0474-9c6f-46bd-a7cf-57bb0b19b702-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m5xj2\" (UID: \"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.503441 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.503443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzn5b\" (UniqueName: \"kubernetes.io/projected/d2bb0474-9c6f-46bd-a7cf-57bb0b19b702-kube-api-access-fzn5b\") pod \"cert-manager-cainjector-559cdd8c87-m5xj2\" (UID: \"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.554655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.554618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm" event={"ID":"de8c9501-8738-4e2f-bccc-bb39d7bb58ea","Type":"ContainerDied","Data":"3cb72d4a3aa28a2ea39c414f44f8f3a087bf080c608d150b9f0845e1555de96a"}
Jul 27 21:06:55.554655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.554650    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrbwm"
Jul 27 21:06:55.554848 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.554666    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb72d4a3aa28a2ea39c414f44f8f3a087bf080c608d150b9f0845e1555de96a"
Jul 27 21:06:55.604558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.604505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bb0474-9c6f-46bd-a7cf-57bb0b19b702-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m5xj2\" (UID: \"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.604558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.604539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzn5b\" (UniqueName: \"kubernetes.io/projected/d2bb0474-9c6f-46bd-a7cf-57bb0b19b702-kube-api-access-fzn5b\") pod \"cert-manager-cainjector-559cdd8c87-m5xj2\" (UID: \"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.612774 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.612752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bb0474-9c6f-46bd-a7cf-57bb0b19b702-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m5xj2\" (UID: \"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.612873 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.612788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzn5b\" (UniqueName: \"kubernetes.io/projected/d2bb0474-9c6f-46bd-a7cf-57bb0b19b702-kube-api-access-fzn5b\") pod \"cert-manager-cainjector-559cdd8c87-m5xj2\" (UID: \"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.666264 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.666243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"
Jul 27 21:06:55.799321 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:55.796009    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2"]
Jul 27 21:06:55.801143 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:06:55.801112    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2bb0474_9c6f_46bd_a7cf_57bb0b19b702.slice/crio-84ccdfddff89a20a74925b5ae9bee2e5ffac59d83458287148198a31a371fcb6 WatchSource:0}: Error finding container 84ccdfddff89a20a74925b5ae9bee2e5ffac59d83458287148198a31a371fcb6: Status 404 returned error can't find the container with id 84ccdfddff89a20a74925b5ae9bee2e5ffac59d83458287148198a31a371fcb6
Jul 27 21:06:56.561144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:56.561105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2" event={"ID":"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702","Type":"ContainerStarted","Data":"84ccdfddff89a20a74925b5ae9bee2e5ffac59d83458287148198a31a371fcb6"}
Jul 27 21:06:57.989945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:57.989906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:58.573186 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:58.573099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2" event={"ID":"d2bb0474-9c6f-46bd-a7cf-57bb0b19b702","Type":"ContainerStarted","Data":"860bea5770b8973b00fd66c87e5c948207a6f9025d5cf81f824e9c4c5434f8ad"}
Jul 27 21:06:58.587981 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:58.587934    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m5xj2" podStartSLOduration=1.08561548 podStartE2EDuration="3.587918091s" totalImagesPullingTime="2.502302611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:58.587571959 +0000 UTC m=+564.747962318" watchObservedRunningTime="2026-07-27 21:06:58.587918091 +0000 UTC m=+564.748308449"
Jul 27 21:06:59.085530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:59.085496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.145113 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:59.145075    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.330795 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:59.330758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.431074 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:06:59.430990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:05.965845 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:05.965807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:06.069860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:06.069823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:07.717231 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:07.717192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:07.930996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:07.930960    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fdvnp"]
Jul 27 21:07:07.933377 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:07.933360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:07.935541 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:07.935517    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-splsj\""
Jul 27 21:07:07.942172 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:07.942149    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fdvnp"]
Jul 27 21:07:08.107981 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.107956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88fdb87d-ca57-4ce9-a18d-a269fa9990ad-bound-sa-token\") pod \"cert-manager-55b4d954d5-fdvnp\" (UID: \"88fdb87d-ca57-4ce9-a18d-a269fa9990ad\") " pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:08.108125 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.107991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2zlm\" (UniqueName: \"kubernetes.io/projected/88fdb87d-ca57-4ce9-a18d-a269fa9990ad-kube-api-access-w2zlm\") pod \"cert-manager-55b4d954d5-fdvnp\" (UID: \"88fdb87d-ca57-4ce9-a18d-a269fa9990ad\") " pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:08.208474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.208435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88fdb87d-ca57-4ce9-a18d-a269fa9990ad-bound-sa-token\") pod \"cert-manager-55b4d954d5-fdvnp\" (UID: \"88fdb87d-ca57-4ce9-a18d-a269fa9990ad\") " pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:08.208474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.208482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2zlm\" (UniqueName: \"kubernetes.io/projected/88fdb87d-ca57-4ce9-a18d-a269fa9990ad-kube-api-access-w2zlm\") pod \"cert-manager-55b4d954d5-fdvnp\" (UID: \"88fdb87d-ca57-4ce9-a18d-a269fa9990ad\") " pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:08.216718 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.216694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88fdb87d-ca57-4ce9-a18d-a269fa9990ad-bound-sa-token\") pod \"cert-manager-55b4d954d5-fdvnp\" (UID: \"88fdb87d-ca57-4ce9-a18d-a269fa9990ad\") " pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:08.216814 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.216806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2zlm\" (UniqueName: \"kubernetes.io/projected/88fdb87d-ca57-4ce9-a18d-a269fa9990ad-kube-api-access-w2zlm\") pod \"cert-manager-55b4d954d5-fdvnp\" (UID: \"88fdb87d-ca57-4ce9-a18d-a269fa9990ad\") " pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:08.242484 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.242463    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fdvnp"
Jul 27 21:07:08.376035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.375971    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fdvnp"]
Jul 27 21:07:08.378434 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:07:08.378407    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88fdb87d_ca57_4ce9_a18d_a269fa9990ad.slice/crio-b1a7de8b497790dabb62160ca495fea58bf569d6567f5ef92723322c47e457f1 WatchSource:0}: Error finding container b1a7de8b497790dabb62160ca495fea58bf569d6567f5ef92723322c47e457f1: Status 404 returned error can't find the container with id b1a7de8b497790dabb62160ca495fea58bf569d6567f5ef92723322c47e457f1
Jul 27 21:07:08.619295 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.619261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fdvnp" event={"ID":"88fdb87d-ca57-4ce9-a18d-a269fa9990ad","Type":"ContainerStarted","Data":"a350940381b3361e7913c329dada4a376f1a0b892546082cb65b5d3e5e433f31"}
Jul 27 21:07:08.619439 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.619307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fdvnp" event={"ID":"88fdb87d-ca57-4ce9-a18d-a269fa9990ad","Type":"ContainerStarted","Data":"b1a7de8b497790dabb62160ca495fea58bf569d6567f5ef92723322c47e457f1"}
Jul 27 21:07:08.633910 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.633820    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fdvnp" podStartSLOduration=1.633805149 podStartE2EDuration="1.633805149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:08.633312552 +0000 UTC m=+574.793702911" watchObservedRunningTime="2026-07-27 21:07:08.633805149 +0000 UTC m=+574.794195508"
Jul 27 21:07:08.812802 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.812775    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"]
Jul 27 21:07:08.835880 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.835856    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"]
Jul 27 21:07:08.836007 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.835944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:08.838986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.838957    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 21:07:08.839115 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.838963    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 21:07:08.839551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:08.839530    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rggvt\""
Jul 27 21:07:09.015093 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.015026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.015093 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.015064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgbcf\" (UniqueName: \"kubernetes.io/projected/504b13cd-0722-4602-b92a-7e0a53b64a8f-kube-api-access-rgbcf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.015093 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.015083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.116340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.116310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.116462 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.116357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgbcf\" (UniqueName: \"kubernetes.io/projected/504b13cd-0722-4602-b92a-7e0a53b64a8f-kube-api-access-rgbcf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.116531 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.116478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.116756 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.116733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.116815 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.116788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.124344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.124326    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgbcf\" (UniqueName: \"kubernetes.io/projected/504b13cd-0722-4602-b92a-7e0a53b64a8f-kube-api-access-rgbcf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.148227 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.148207    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:09.298427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.298376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"]
Jul 27 21:07:09.301137 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:07:09.301103    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504b13cd_0722_4602_b92a_7e0a53b64a8f.slice/crio-bcf82872f6786c60d0b1c611e40f1d2f22bf27ddcf16b39d0fa69e0603cc10f2 WatchSource:0}: Error finding container bcf82872f6786c60d0b1c611e40f1d2f22bf27ddcf16b39d0fa69e0603cc10f2: Status 404 returned error can't find the container with id bcf82872f6786c60d0b1c611e40f1d2f22bf27ddcf16b39d0fa69e0603cc10f2
Jul 27 21:07:09.625714 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.625632    2579 generic.go:356] "Generic (PLEG): container finished" podID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerID="6e8b3c423bd363fee4bab6a429fb157c19f198e09315080d86c8af05f2386b0c" exitCode=0
Jul 27 21:07:09.625862 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.625722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn" event={"ID":"504b13cd-0722-4602-b92a-7e0a53b64a8f","Type":"ContainerDied","Data":"6e8b3c423bd363fee4bab6a429fb157c19f198e09315080d86c8af05f2386b0c"}
Jul 27 21:07:09.625862 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:09.625779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn" event={"ID":"504b13cd-0722-4602-b92a-7e0a53b64a8f","Type":"ContainerStarted","Data":"bcf82872f6786c60d0b1c611e40f1d2f22bf27ddcf16b39d0fa69e0603cc10f2"}
Jul 27 21:07:10.632645 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:10.632592    2579 generic.go:356] "Generic (PLEG): container finished" podID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerID="7558bd3a8246ad09529b7b4543fe4915e1ca87a423cb0e262aa3d9d29865e5b3" exitCode=0
Jul 27 21:07:10.632645 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:10.632638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn" event={"ID":"504b13cd-0722-4602-b92a-7e0a53b64a8f","Type":"ContainerDied","Data":"7558bd3a8246ad09529b7b4543fe4915e1ca87a423cb0e262aa3d9d29865e5b3"}
Jul 27 21:07:11.639746 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:11.639714    2579 generic.go:356] "Generic (PLEG): container finished" podID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerID="4b0e0902e1bb2e65da906d551c0a9d269faba998dc173ead6d2d507abb0a6217" exitCode=0
Jul 27 21:07:11.640186 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:11.639804    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn" event={"ID":"504b13cd-0722-4602-b92a-7e0a53b64a8f","Type":"ContainerDied","Data":"4b0e0902e1bb2e65da906d551c0a9d269faba998dc173ead6d2d507abb0a6217"}
Jul 27 21:07:12.795334 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.795311    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:12.840219 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.840194    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-util\") pod \"504b13cd-0722-4602-b92a-7e0a53b64a8f\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") "
Jul 27 21:07:12.840339 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.840229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgbcf\" (UniqueName: \"kubernetes.io/projected/504b13cd-0722-4602-b92a-7e0a53b64a8f-kube-api-access-rgbcf\") pod \"504b13cd-0722-4602-b92a-7e0a53b64a8f\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") "
Jul 27 21:07:12.840339 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.840276    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-bundle\") pod \"504b13cd-0722-4602-b92a-7e0a53b64a8f\" (UID: \"504b13cd-0722-4602-b92a-7e0a53b64a8f\") "
Jul 27 21:07:12.841077 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.841055    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-bundle" (OuterVolumeSpecName: "bundle") pod "504b13cd-0722-4602-b92a-7e0a53b64a8f" (UID: "504b13cd-0722-4602-b92a-7e0a53b64a8f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:07:12.842544 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.842527    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504b13cd-0722-4602-b92a-7e0a53b64a8f-kube-api-access-rgbcf" (OuterVolumeSpecName: "kube-api-access-rgbcf") pod "504b13cd-0722-4602-b92a-7e0a53b64a8f" (UID: "504b13cd-0722-4602-b92a-7e0a53b64a8f"). InnerVolumeSpecName "kube-api-access-rgbcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:07:12.845572 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.845552    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-util" (OuterVolumeSpecName: "util") pod "504b13cd-0722-4602-b92a-7e0a53b64a8f" (UID: "504b13cd-0722-4602-b92a-7e0a53b64a8f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:07:12.941010 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.940955    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:07:12.941010 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.940977    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504b13cd-0722-4602-b92a-7e0a53b64a8f-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:07:12.941010 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:12.940985    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgbcf\" (UniqueName: \"kubernetes.io/projected/504b13cd-0722-4602-b92a-7e0a53b64a8f-kube-api-access-rgbcf\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:07:13.653657 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:13.653625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn" event={"ID":"504b13cd-0722-4602-b92a-7e0a53b64a8f","Type":"ContainerDied","Data":"bcf82872f6786c60d0b1c611e40f1d2f22bf27ddcf16b39d0fa69e0603cc10f2"}
Jul 27 21:07:13.653816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:13.653673    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcf82872f6786c60d0b1c611e40f1d2f22bf27ddcf16b39d0fa69e0603cc10f2"
Jul 27 21:07:13.653816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:13.653674    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7sxn"
Jul 27 21:07:20.757469 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:20.757437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:20.861585 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:20.861548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:21.359092 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.359061    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:21.577127 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.577083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:21.673260 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.673180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:21.747165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747131    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"]
Jul 27 21:07:21.747459 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747447    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerName="util"
Jul 27 21:07:21.747505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747461    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerName="util"
Jul 27 21:07:21.747505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747476    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerName="pull"
Jul 27 21:07:21.747505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747482    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerName="pull"
Jul 27 21:07:21.747505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747504    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerName="extract"
Jul 27 21:07:21.747685 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747510    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerName="extract"
Jul 27 21:07:21.747685 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.747573    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="504b13cd-0722-4602-b92a-7e0a53b64a8f" containerName="extract"
Jul 27 21:07:21.755097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.755072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.760442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.760413    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 21:07:21.760442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.760420    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 21:07:21.760996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.760442    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 21:07:21.760996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.760447    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 21:07:21.760996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.760696    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g5q6d\""
Jul 27 21:07:21.768671 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.768650    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"]
Jul 27 21:07:21.800722 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.800690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5e81bf2-50e2-4922-b337-7873cb6fa907-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.800887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.800749    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjmsn\" (UniqueName: \"kubernetes.io/projected/c5e81bf2-50e2-4922-b337-7873cb6fa907-kube-api-access-wjmsn\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.800887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.800775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e81bf2-50e2-4922-b337-7873cb6fa907-tmp\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.800887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.800802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5e81bf2-50e2-4922-b337-7873cb6fa907-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.800887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.800825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5e81bf2-50e2-4922-b337-7873cb6fa907-manifests\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.867569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.867535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:21.901922 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.901899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjmsn\" (UniqueName: \"kubernetes.io/projected/c5e81bf2-50e2-4922-b337-7873cb6fa907-kube-api-access-wjmsn\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.902060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.901933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e81bf2-50e2-4922-b337-7873cb6fa907-tmp\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.902060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.901964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5e81bf2-50e2-4922-b337-7873cb6fa907-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.902060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.901987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5e81bf2-50e2-4922-b337-7873cb6fa907-manifests\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.902060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.902036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5e81bf2-50e2-4922-b337-7873cb6fa907-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.902438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.902412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5e81bf2-50e2-4922-b337-7873cb6fa907-manifests\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.904375 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.904354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e81bf2-50e2-4922-b337-7873cb6fa907-tmp\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.904682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.904664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5e81bf2-50e2-4922-b337-7873cb6fa907-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.904762 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.904666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5e81bf2-50e2-4922-b337-7873cb6fa907-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.910215 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.910195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjmsn\" (UniqueName: \"kubernetes.io/projected/c5e81bf2-50e2-4922-b337-7873cb6fa907-kube-api-access-wjmsn\") pod \"opendatahub-operator-controller-manager-798cd98846-vxk89\" (UID: \"c5e81bf2-50e2-4922-b337-7873cb6fa907\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:21.974753 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:21.974687    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:22.066372 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.066345    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:22.071328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.071303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:22.170761 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.170722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:22.213192 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.213169    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"]
Jul 27 21:07:22.215589 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:07:22.215561    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e81bf2_50e2_4922_b337_7873cb6fa907.slice/crio-0eb4e90efa146914c11fd0f08e2b93ee99deabb48c83d7db1700c1b4ae72a711 WatchSource:0}: Error finding container 0eb4e90efa146914c11fd0f08e2b93ee99deabb48c83d7db1700c1b4ae72a711: Status 404 returned error can't find the container with id 0eb4e90efa146914c11fd0f08e2b93ee99deabb48c83d7db1700c1b4ae72a711
Jul 27 21:07:22.270032 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.270000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:22.379328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.379294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:22.472723 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.472684    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:22.704434 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:22.704359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89" event={"ID":"c5e81bf2-50e2-4922-b337-7873cb6fa907","Type":"ContainerStarted","Data":"0eb4e90efa146914c11fd0f08e2b93ee99deabb48c83d7db1700c1b4ae72a711"}
Jul 27 21:07:25.727962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:25.727930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89" event={"ID":"c5e81bf2-50e2-4922-b337-7873cb6fa907","Type":"ContainerStarted","Data":"78f912da01a8ca188c24626129ec88ff13be6821dfe14529ba47bbb4c72901cb"}
Jul 27 21:07:26.734102 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:26.734066    2579 generic.go:356] "Generic (PLEG): container finished" podID="c5e81bf2-50e2-4922-b337-7873cb6fa907" containerID="78f912da01a8ca188c24626129ec88ff13be6821dfe14529ba47bbb4c72901cb" exitCode=0
Jul 27 21:07:26.734463 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:26.734157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89" event={"ID":"c5e81bf2-50e2-4922-b337-7873cb6fa907","Type":"ContainerDied","Data":"78f912da01a8ca188c24626129ec88ff13be6821dfe14529ba47bbb4c72901cb"}
Jul 27 21:07:27.742394 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:27.742297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89" event={"ID":"c5e81bf2-50e2-4922-b337-7873cb6fa907","Type":"ContainerStarted","Data":"f2a368408c153618ecb1da23798167c7457da78b4303db1d65df6cfdef8244a1"}
Jul 27 21:07:27.742769 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:27.742499    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:27.762878 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:27.762828    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89" podStartSLOduration=1.893034232 podStartE2EDuration="6.762813182s" totalImagesPullingTime="3.869105283s" totalInitContainerRuntime="1.000673667s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:27.760097553 +0000 UTC m=+593.920487912" watchObservedRunningTime="2026-07-27 21:07:27.762813182 +0000 UTC m=+593.923203542"
Jul 27 21:07:32.974006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:32.973967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:33.068401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:33.068370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:34.019962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:34.019926    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:34.117497 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:34.117456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:34.286099 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:34.286033    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:07:34.286099 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:34.286083    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:07:34.583511 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:34.583418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:34.688617 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:34.688551    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:38.749293 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:38.749263    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-vxk89"
Jul 27 21:07:40.267407 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.267371    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"]
Jul 27 21:07:40.270737 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.270720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.273203 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.273180    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 21:07:40.273417 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.273401    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hzf8w\""
Jul 27 21:07:40.274202 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.274178    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:07:40.274309 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.274293    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 21:07:40.274378 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.274347    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 21:07:40.274438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.274399    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 21:07:40.282896 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.282876    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"]
Jul 27 21:07:40.357800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.357775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6e65121-f9c9-49a4-9d93-79775f1ff793-metrics-cert\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.357942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.357821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c6e65121-f9c9-49a4-9d93-79775f1ff793-manager-config\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.357942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.357845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6e65121-f9c9-49a4-9d93-79775f1ff793-cert\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.357942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.357916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zggk4\" (UniqueName: \"kubernetes.io/projected/c6e65121-f9c9-49a4-9d93-79775f1ff793-kube-api-access-zggk4\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.459317 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.459281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6e65121-f9c9-49a4-9d93-79775f1ff793-metrics-cert\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.459317 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.459336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c6e65121-f9c9-49a4-9d93-79775f1ff793-manager-config\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.459523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.459358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6e65121-f9c9-49a4-9d93-79775f1ff793-cert\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.459523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.459411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zggk4\" (UniqueName: \"kubernetes.io/projected/c6e65121-f9c9-49a4-9d93-79775f1ff793-kube-api-access-zggk4\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.460023 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.459995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c6e65121-f9c9-49a4-9d93-79775f1ff793-manager-config\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.461886 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.461864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6e65121-f9c9-49a4-9d93-79775f1ff793-metrics-cert\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.461980 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.461898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6e65121-f9c9-49a4-9d93-79775f1ff793-cert\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.467411 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.467389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zggk4\" (UniqueName: \"kubernetes.io/projected/c6e65121-f9c9-49a4-9d93-79775f1ff793-kube-api-access-zggk4\") pod \"lws-controller-manager-75c6cc9f98-pcc97\" (UID: \"c6e65121-f9c9-49a4-9d93-79775f1ff793\") " pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.580487 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.580467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:40.746843 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.746817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"]
Jul 27 21:07:40.749651 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:07:40.749582    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e65121_f9c9_49a4_9d93_79775f1ff793.slice/crio-4c835dd5c87420f7c6996f7410e8ffb7a691ac51e03533f7fd0383f8c1cb5fb1 WatchSource:0}: Error finding container 4c835dd5c87420f7c6996f7410e8ffb7a691ac51e03533f7fd0383f8c1cb5fb1: Status 404 returned error can't find the container with id 4c835dd5c87420f7c6996f7410e8ffb7a691ac51e03533f7fd0383f8c1cb5fb1
Jul 27 21:07:40.751058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.751027    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:40.751739 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.751719    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:07:40.803938 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:40.803903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97" event={"ID":"c6e65121-f9c9-49a4-9d93-79775f1ff793","Type":"ContainerStarted","Data":"4c835dd5c87420f7c6996f7410e8ffb7a691ac51e03533f7fd0383f8c1cb5fb1"}
Jul 27 21:07:42.151827 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:42.151780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:42.404146 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:42.404077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:42.479437 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:42.479405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:42.818646 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:42.818577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97" event={"ID":"c6e65121-f9c9-49a4-9d93-79775f1ff793","Type":"ContainerStarted","Data":"32587ba05c61f24dd0b5278f249e768cb2ca4058f61d0b330c5dbb3c7a3c6e5e"}
Jul 27 21:07:42.818844 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:42.818735    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:42.838111 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:42.838060    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97" podStartSLOduration=1.242312955 podStartE2EDuration="2.83804588s" totalImagesPullingTime="1.595732925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:42.836001381 +0000 UTC m=+608.996391765" watchObservedRunningTime="2026-07-27 21:07:42.83804588 +0000 UTC m=+608.998436239"
Jul 27 21:07:46.471396 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:46.471362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:46.791767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:46.791727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:47.858762 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:47.858729    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:47.942530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:47.942497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:49.477746 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.477711    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"]
Jul 27 21:07:49.482915 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.482895    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.485466 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.485448    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 21:07:49.485650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.485522    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 21:07:49.485650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.485488    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 21:07:49.485885 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.485870    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-76mmz\""
Jul 27 21:07:49.488917 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.488897    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 21:07:49.494652 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.494629    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"]
Jul 27 21:07:49.543053 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.543022    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:49.643416 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.643386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.643576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.643458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.643576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.643505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.643576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.643524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.643576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.643545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.643576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.643562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.643805 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.643629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6kzr\" (UniqueName: \"kubernetes.io/projected/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-kube-api-access-p6kzr\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.744715 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.744548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.744715 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.744592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.744715 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.744649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6kzr\" (UniqueName: \"kubernetes.io/projected/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-kube-api-access-p6kzr\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.744715 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.744693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.745204 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.744801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.745204 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.744842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.745204 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.744871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.745437 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.745411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.747393 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.747366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.747567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.747543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.747847 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.747828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.747907 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.747828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.754155 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.754130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.754368 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.754351    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6kzr\" (UniqueName: \"kubernetes.io/projected/1fc5c72d-dfb4-40b9-9473-84fa37c6e85b-kube-api-access-p6kzr\") pod \"istiod-openshift-gateway-5677ccb49b-s8ml7\" (UID: \"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.793293 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.793269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:49.933342 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:49.933310    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"]
Jul 27 21:07:49.936531 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:07:49.936504    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc5c72d_dfb4_40b9_9473_84fa37c6e85b.slice/crio-3d68882b99e8517dedf27a506473f9b3436710a70048afb8c7b4f81a3adb21a5 WatchSource:0}: Error finding container 3d68882b99e8517dedf27a506473f9b3436710a70048afb8c7b4f81a3adb21a5: Status 404 returned error can't find the container with id 3d68882b99e8517dedf27a506473f9b3436710a70048afb8c7b4f81a3adb21a5
Jul 27 21:07:50.862674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:50.862638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7" event={"ID":"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b","Type":"ContainerStarted","Data":"3d68882b99e8517dedf27a506473f9b3436710a70048afb8c7b4f81a3adb21a5"}
Jul 27 21:07:51.961851 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:51.961819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:52.089582 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.089545    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:52.301658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.301621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:52.358026 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.357995    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:07:52.358088 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.358066    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:07:52.641150 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.641054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:52.756772 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.756740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:52.876187 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.876157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7" event={"ID":"1fc5c72d-dfb4-40b9-9473-84fa37c6e85b","Type":"ContainerStarted","Data":"11112d25ef6b39d34ac839e9cee21f1be3910d7eb31656b72b82b0edaec8c50b"}
Jul 27 21:07:52.876349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.876265    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:07:52.903730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:52.903649    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7" podStartSLOduration=1.484409502 podStartE2EDuration="3.903635605s" totalImagesPullingTime="2.419226103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:52.901708698 +0000 UTC m=+619.062099072" watchObservedRunningTime="2026-07-27 21:07:52.903635605 +0000 UTC m=+619.064025964"
Jul 27 21:07:53.286565 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:53.286524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:53.408733 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:53.408695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:53.553377 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:53.553290    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:53.825824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:53.825745    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75c6cc9f98-pcc97"
Jul 27 21:07:53.883805 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:53.883759    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-s8ml7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:07:53.883964 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:53.883825    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7" podUID="1fc5c72d-dfb4-40b9-9473-84fa37c6e85b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:07:54.332063 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:54.332028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:54.516448 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:54.516354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:55.083274 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:55.083239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:56.883287 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:07:56.883256    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s8ml7"
Jul 27 21:08:42.341550 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:42.341505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:42.432005 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:42.431976    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:42.538944 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:42.538911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:57.864544 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:57.864505    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"]
Jul 27 21:08:57.868671 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:57.868655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:57.870988 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:57.870970    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 21:08:57.871835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:57.871818    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lljbj\""
Jul 27 21:08:57.871903 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:57.871853    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 21:08:57.877485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:57.877466    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"]
Jul 27 21:08:58.005439 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.005412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs7wg\" (UniqueName: \"kubernetes.io/projected/93869c16-e3ab-4f23-aa26-25e99de5e5d4-kube-api-access-cs7wg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.005556 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.005453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.005556 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.005478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.106268 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.106240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs7wg\" (UniqueName: \"kubernetes.io/projected/93869c16-e3ab-4f23-aa26-25e99de5e5d4-kube-api-access-cs7wg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.106398 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.106280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.106398 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.106303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.106660 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.106640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.106724 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.106673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.115436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.115378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs7wg\" (UniqueName: \"kubernetes.io/projected/93869c16-e3ab-4f23-aa26-25e99de5e5d4-kube-api-access-cs7wg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.179045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.179016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:08:58.310636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.310541    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"]
Jul 27 21:08:58.312896 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:08:58.312872    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93869c16_e3ab_4f23_aa26_25e99de5e5d4.slice/crio-e77d321b602f48e95f4a3bc1bfcee272a40a225c5e8f1cd00e30ca648a0b016e WatchSource:0}: Error finding container e77d321b602f48e95f4a3bc1bfcee272a40a225c5e8f1cd00e30ca648a0b016e: Status 404 returned error can't find the container with id e77d321b602f48e95f4a3bc1bfcee272a40a225c5e8f1cd00e30ca648a0b016e
Jul 27 21:08:58.662327 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.662258    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"]
Jul 27 21:08:58.665792 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.665776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.673803 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.673782    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"]
Jul 27 21:08:58.813102 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.813073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.813246 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.813129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.813246 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.813182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5knf\" (UniqueName: \"kubernetes.io/projected/4c6d9379-020d-4568-8285-ccd4e64d7f23-kube-api-access-b5knf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.914144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.914071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.914485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.914144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.914485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.914182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5knf\" (UniqueName: \"kubernetes.io/projected/4c6d9379-020d-4568-8285-ccd4e64d7f23-kube-api-access-b5knf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.914485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.914405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.914485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.914438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.923478 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.923459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5knf\" (UniqueName: \"kubernetes.io/projected/4c6d9379-020d-4568-8285-ccd4e64d7f23-kube-api-access-b5knf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:58.975436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:58.975408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:08:59.106995 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.106970    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"]
Jul 27 21:08:59.108701 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:08:59.108678    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6d9379_020d_4568_8285_ccd4e64d7f23.slice/crio-fe6736749fcda4035c6dffbc053c479d9f80523aa742a966d125dccb664472f5 WatchSource:0}: Error finding container fe6736749fcda4035c6dffbc053c479d9f80523aa742a966d125dccb664472f5: Status 404 returned error can't find the container with id fe6736749fcda4035c6dffbc053c479d9f80523aa742a966d125dccb664472f5
Jul 27 21:08:59.211005 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.210976    2579 generic.go:356] "Generic (PLEG): container finished" podID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerID="d5361cc6d4c99ad7704a259d7dc68f5669cebd4ba6753c47b78d69f9c2495c09" exitCode=0
Jul 27 21:08:59.211144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.211057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc" event={"ID":"93869c16-e3ab-4f23-aa26-25e99de5e5d4","Type":"ContainerDied","Data":"d5361cc6d4c99ad7704a259d7dc68f5669cebd4ba6753c47b78d69f9c2495c09"}
Jul 27 21:08:59.211144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.211116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc" event={"ID":"93869c16-e3ab-4f23-aa26-25e99de5e5d4","Type":"ContainerStarted","Data":"e77d321b602f48e95f4a3bc1bfcee272a40a225c5e8f1cd00e30ca648a0b016e"}
Jul 27 21:08:59.213057 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.213036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw" event={"ID":"4c6d9379-020d-4568-8285-ccd4e64d7f23","Type":"ContainerStarted","Data":"76daa744ab612eeb8ef9c6dc610cf4957f2b25b56eda738bd4adde78baf815dc"}
Jul 27 21:08:59.213177 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.213072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw" event={"ID":"4c6d9379-020d-4568-8285-ccd4e64d7f23","Type":"ContainerStarted","Data":"fe6736749fcda4035c6dffbc053c479d9f80523aa742a966d125dccb664472f5"}
Jul 27 21:08:59.459063 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.459002    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"]
Jul 27 21:08:59.462403 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.462388    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.470937 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.470904    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"]
Jul 27 21:08:59.620284 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.620256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.620403 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.620291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6fk\" (UniqueName: \"kubernetes.io/projected/6b57081e-f576-4d2c-83d4-a2c880abfa83-kube-api-access-tn6fk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.620403 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.620309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.721243 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.721188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.721243 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.721220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6fk\" (UniqueName: \"kubernetes.io/projected/6b57081e-f576-4d2c-83d4-a2c880abfa83-kube-api-access-tn6fk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.721243 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.721238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.721569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.721543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.721569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.721563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.730037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.730010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6fk\" (UniqueName: \"kubernetes.io/projected/6b57081e-f576-4d2c-83d4-a2c880abfa83-kube-api-access-tn6fk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.772522 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.772499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:08:59.934400 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:08:59.934376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"]
Jul 27 21:08:59.934736 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:08:59.934671    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b57081e_f576_4d2c_83d4_a2c880abfa83.slice/crio-512af0e39350274450f1c069f2de36c931beda73b1533c8610d1412c5a50d90f WatchSource:0}: Error finding container 512af0e39350274450f1c069f2de36c931beda73b1533c8610d1412c5a50d90f: Status 404 returned error can't find the container with id 512af0e39350274450f1c069f2de36c931beda73b1533c8610d1412c5a50d90f
Jul 27 21:09:00.062862 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.062828    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"]
Jul 27 21:09:00.066757 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.066740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.075309 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.075284    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"]
Jul 27 21:09:00.219258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.219228    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerID="dab8e298c8908b098b713d3792d80e01ad9e91ef15e01e86ac4673f95c55e06e" exitCode=0
Jul 27 21:09:00.219353 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.219293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d" event={"ID":"6b57081e-f576-4d2c-83d4-a2c880abfa83","Type":"ContainerDied","Data":"dab8e298c8908b098b713d3792d80e01ad9e91ef15e01e86ac4673f95c55e06e"}
Jul 27 21:09:00.219397 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.219351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d" event={"ID":"6b57081e-f576-4d2c-83d4-a2c880abfa83","Type":"ContainerStarted","Data":"512af0e39350274450f1c069f2de36c931beda73b1533c8610d1412c5a50d90f"}
Jul 27 21:09:00.221190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.221163    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerID="76daa744ab612eeb8ef9c6dc610cf4957f2b25b56eda738bd4adde78baf815dc" exitCode=0
Jul 27 21:09:00.221335 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.221206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw" event={"ID":"4c6d9379-020d-4568-8285-ccd4e64d7f23","Type":"ContainerDied","Data":"76daa744ab612eeb8ef9c6dc610cf4957f2b25b56eda738bd4adde78baf815dc"}
Jul 27 21:09:00.226491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.226468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.226636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.226506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.226636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.226542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqnnw\" (UniqueName: \"kubernetes.io/projected/a8793dcb-2bbd-4081-968d-33373ba6e839-kube-api-access-vqnnw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.328004 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.327973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.328111 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.328019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.328111 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.328061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqnnw\" (UniqueName: \"kubernetes.io/projected/a8793dcb-2bbd-4081-968d-33373ba6e839-kube-api-access-vqnnw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.328362 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.328342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.328460 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.328402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.335996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.335978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqnnw\" (UniqueName: \"kubernetes.io/projected/a8793dcb-2bbd-4081-968d-33373ba6e839-kube-api-access-vqnnw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.394077 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.394055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:00.525063 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:00.525039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"]
Jul 27 21:09:00.527494 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:09:00.527470    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8793dcb_2bbd_4081_968d_33373ba6e839.slice/crio-9b78da373df9ad1534917f36083b704318545cf7207a5cfeefe9a037b30a6a01 WatchSource:0}: Error finding container 9b78da373df9ad1534917f36083b704318545cf7207a5cfeefe9a037b30a6a01: Status 404 returned error can't find the container with id 9b78da373df9ad1534917f36083b704318545cf7207a5cfeefe9a037b30a6a01
Jul 27 21:09:01.228111 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.228051    2579 generic.go:356] "Generic (PLEG): container finished" podID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerID="0f781e44912cc40faadcbe03f465e29e4bcfab38f50a199181c9aa67c94d75a0" exitCode=0
Jul 27 21:09:01.228426 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.228130    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc" event={"ID":"93869c16-e3ab-4f23-aa26-25e99de5e5d4","Type":"ContainerDied","Data":"0f781e44912cc40faadcbe03f465e29e4bcfab38f50a199181c9aa67c94d75a0"}
Jul 27 21:09:01.230079 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.230058    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerID="1bb1432874475ccd71f9dc22b9c82d36f189dfdf4902559c33ff5200a90f7654" exitCode=0
Jul 27 21:09:01.230171 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.230129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw" event={"ID":"4c6d9379-020d-4568-8285-ccd4e64d7f23","Type":"ContainerDied","Data":"1bb1432874475ccd71f9dc22b9c82d36f189dfdf4902559c33ff5200a90f7654"}
Jul 27 21:09:01.232066 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.232047    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerID="b6b0377fe73faf0b2a06647fcf78c308950758700c58c6680c9b28ea90dfca81" exitCode=0
Jul 27 21:09:01.232159 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.232116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d" event={"ID":"6b57081e-f576-4d2c-83d4-a2c880abfa83","Type":"ContainerDied","Data":"b6b0377fe73faf0b2a06647fcf78c308950758700c58c6680c9b28ea90dfca81"}
Jul 27 21:09:01.233783 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.233761    2579 generic.go:356] "Generic (PLEG): container finished" podID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerID="826a471b038d1a808ad1f29183767fe9951f10f32683d1ec45fc60f0336c0e15" exitCode=0
Jul 27 21:09:01.233887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.233834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg" event={"ID":"a8793dcb-2bbd-4081-968d-33373ba6e839","Type":"ContainerDied","Data":"826a471b038d1a808ad1f29183767fe9951f10f32683d1ec45fc60f0336c0e15"}
Jul 27 21:09:01.233887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:01.233877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg" event={"ID":"a8793dcb-2bbd-4081-968d-33373ba6e839","Type":"ContainerStarted","Data":"9b78da373df9ad1534917f36083b704318545cf7207a5cfeefe9a037b30a6a01"}
Jul 27 21:09:02.241528 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:02.241504    2579 generic.go:356] "Generic (PLEG): container finished" podID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerID="74069a29ff0bc295153d8f4f566b5540fb818077f84e83cd914a4706f63e6eaf" exitCode=0
Jul 27 21:09:02.241914 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:02.241593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc" event={"ID":"93869c16-e3ab-4f23-aa26-25e99de5e5d4","Type":"ContainerDied","Data":"74069a29ff0bc295153d8f4f566b5540fb818077f84e83cd914a4706f63e6eaf"}
Jul 27 21:09:02.243831 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:02.243806    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerID="3db8cf9a0c10e7f3855523836553c7dc08b68211cd9ec27c529b1ea46856053e" exitCode=0
Jul 27 21:09:02.243950 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:02.243883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw" event={"ID":"4c6d9379-020d-4568-8285-ccd4e64d7f23","Type":"ContainerDied","Data":"3db8cf9a0c10e7f3855523836553c7dc08b68211cd9ec27c529b1ea46856053e"}
Jul 27 21:09:02.246151 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:02.246130    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerID="22719dae44f685ee9b6caba454b462a940fee008f20c3ba5e49483b5d61e4437" exitCode=0
Jul 27 21:09:02.246244 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:02.246210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d" event={"ID":"6b57081e-f576-4d2c-83d4-a2c880abfa83","Type":"ContainerDied","Data":"22719dae44f685ee9b6caba454b462a940fee008f20c3ba5e49483b5d61e4437"}
Jul 27 21:09:02.248143 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:02.248124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg" event={"ID":"a8793dcb-2bbd-4081-968d-33373ba6e839","Type":"ContainerStarted","Data":"4b7584cab71e1de0b0b29de2588b769dcad9dfdee504468732639e96df26db9b"}
Jul 27 21:09:03.255047 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.255018    2579 generic.go:356] "Generic (PLEG): container finished" podID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerID="4b7584cab71e1de0b0b29de2588b769dcad9dfdee504468732639e96df26db9b" exitCode=0
Jul 27 21:09:03.255509 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.255107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg" event={"ID":"a8793dcb-2bbd-4081-968d-33373ba6e839","Type":"ContainerDied","Data":"4b7584cab71e1de0b0b29de2588b769dcad9dfdee504468732639e96df26db9b"}
Jul 27 21:09:03.393533 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.393507    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:09:03.498502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.498482    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:09:03.501739 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.501719    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:09:03.557500 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.557475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-util\") pod \"4c6d9379-020d-4568-8285-ccd4e64d7f23\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") "
Jul 27 21:09:03.557665 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.557512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5knf\" (UniqueName: \"kubernetes.io/projected/4c6d9379-020d-4568-8285-ccd4e64d7f23-kube-api-access-b5knf\") pod \"4c6d9379-020d-4568-8285-ccd4e64d7f23\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") "
Jul 27 21:09:03.557665 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.557561    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-bundle\") pod \"4c6d9379-020d-4568-8285-ccd4e64d7f23\" (UID: \"4c6d9379-020d-4568-8285-ccd4e64d7f23\") "
Jul 27 21:09:03.558158 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.558134    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-bundle" (OuterVolumeSpecName: "bundle") pod "4c6d9379-020d-4568-8285-ccd4e64d7f23" (UID: "4c6d9379-020d-4568-8285-ccd4e64d7f23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:03.559825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.559802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6d9379-020d-4568-8285-ccd4e64d7f23-kube-api-access-b5knf" (OuterVolumeSpecName: "kube-api-access-b5knf") pod "4c6d9379-020d-4568-8285-ccd4e64d7f23" (UID: "4c6d9379-020d-4568-8285-ccd4e64d7f23"). InnerVolumeSpecName "kube-api-access-b5knf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:03.562867 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.562845    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-util" (OuterVolumeSpecName: "util") pod "4c6d9379-020d-4568-8285-ccd4e64d7f23" (UID: "4c6d9379-020d-4568-8285-ccd4e64d7f23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:03.658667 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.658651    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-util\") pod \"6b57081e-f576-4d2c-83d4-a2c880abfa83\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") "
Jul 27 21:09:03.658736 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.658696    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-bundle\") pod \"6b57081e-f576-4d2c-83d4-a2c880abfa83\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") "
Jul 27 21:09:03.658736 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.658720    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-bundle\") pod \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") "
Jul 27 21:09:03.658796 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.658737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn6fk\" (UniqueName: \"kubernetes.io/projected/6b57081e-f576-4d2c-83d4-a2c880abfa83-kube-api-access-tn6fk\") pod \"6b57081e-f576-4d2c-83d4-a2c880abfa83\" (UID: \"6b57081e-f576-4d2c-83d4-a2c880abfa83\") "
Jul 27 21:09:03.658796 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.658759    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-util\") pod \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") "
Jul 27 21:09:03.658863 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.658805    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs7wg\" (UniqueName: \"kubernetes.io/projected/93869c16-e3ab-4f23-aa26-25e99de5e5d4-kube-api-access-cs7wg\") pod \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\" (UID: \"93869c16-e3ab-4f23-aa26-25e99de5e5d4\") "
Jul 27 21:09:03.659070 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.659051    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.659146 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.659074    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5knf\" (UniqueName: \"kubernetes.io/projected/4c6d9379-020d-4568-8285-ccd4e64d7f23-kube-api-access-b5knf\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.659146 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.659090    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6d9379-020d-4568-8285-ccd4e64d7f23-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.659528 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.659398    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-bundle" (OuterVolumeSpecName: "bundle") pod "93869c16-e3ab-4f23-aa26-25e99de5e5d4" (UID: "93869c16-e3ab-4f23-aa26-25e99de5e5d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:03.659625 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.659569    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-bundle" (OuterVolumeSpecName: "bundle") pod "6b57081e-f576-4d2c-83d4-a2c880abfa83" (UID: "6b57081e-f576-4d2c-83d4-a2c880abfa83"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:03.660896 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.660867    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93869c16-e3ab-4f23-aa26-25e99de5e5d4-kube-api-access-cs7wg" (OuterVolumeSpecName: "kube-api-access-cs7wg") pod "93869c16-e3ab-4f23-aa26-25e99de5e5d4" (UID: "93869c16-e3ab-4f23-aa26-25e99de5e5d4"). InnerVolumeSpecName "kube-api-access-cs7wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:03.660963 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.660930    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b57081e-f576-4d2c-83d4-a2c880abfa83-kube-api-access-tn6fk" (OuterVolumeSpecName: "kube-api-access-tn6fk") pod "6b57081e-f576-4d2c-83d4-a2c880abfa83" (UID: "6b57081e-f576-4d2c-83d4-a2c880abfa83"). InnerVolumeSpecName "kube-api-access-tn6fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:03.664562 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.664541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-util" (OuterVolumeSpecName: "util") pod "6b57081e-f576-4d2c-83d4-a2c880abfa83" (UID: "6b57081e-f576-4d2c-83d4-a2c880abfa83"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:03.665118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.665096    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-util" (OuterVolumeSpecName: "util") pod "93869c16-e3ab-4f23-aa26-25e99de5e5d4" (UID: "93869c16-e3ab-4f23-aa26-25e99de5e5d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:03.759637 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.759586    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.759637 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.759636    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b57081e-f576-4d2c-83d4-a2c880abfa83-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.759637 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.759645    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.759783 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.759653    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn6fk\" (UniqueName: \"kubernetes.io/projected/6b57081e-f576-4d2c-83d4-a2c880abfa83-kube-api-access-tn6fk\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.759783 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.759662    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93869c16-e3ab-4f23-aa26-25e99de5e5d4-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:03.759783 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:03.759670    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs7wg\" (UniqueName: \"kubernetes.io/projected/93869c16-e3ab-4f23-aa26-25e99de5e5d4-kube-api-access-cs7wg\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:04.262093 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.262062    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw"
Jul 27 21:09:04.262488 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.262058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw" event={"ID":"4c6d9379-020d-4568-8285-ccd4e64d7f23","Type":"ContainerDied","Data":"fe6736749fcda4035c6dffbc053c479d9f80523aa742a966d125dccb664472f5"}
Jul 27 21:09:04.262488 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.262223    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe6736749fcda4035c6dffbc053c479d9f80523aa742a966d125dccb664472f5"
Jul 27 21:09:04.263967 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.263946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d" event={"ID":"6b57081e-f576-4d2c-83d4-a2c880abfa83","Type":"ContainerDied","Data":"512af0e39350274450f1c069f2de36c931beda73b1533c8610d1412c5a50d90f"}
Jul 27 21:09:04.264085 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.263985    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="512af0e39350274450f1c069f2de36c931beda73b1533c8610d1412c5a50d90f"
Jul 27 21:09:04.264085 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.263953    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d"
Jul 27 21:09:04.266094 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.266071    2579 generic.go:356] "Generic (PLEG): container finished" podID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerID="71bf45f74ae1fe4338419147d95ed1b6273bc68ff462b905be6ce097900a9c5a" exitCode=0
Jul 27 21:09:04.266196 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.266161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg" event={"ID":"a8793dcb-2bbd-4081-968d-33373ba6e839","Type":"ContainerDied","Data":"71bf45f74ae1fe4338419147d95ed1b6273bc68ff462b905be6ce097900a9c5a"}
Jul 27 21:09:04.268131 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.268111    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc" event={"ID":"93869c16-e3ab-4f23-aa26-25e99de5e5d4","Type":"ContainerDied","Data":"e77d321b602f48e95f4a3bc1bfcee272a40a225c5e8f1cd00e30ca648a0b016e"}
Jul 27 21:09:04.268131 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.268130    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc"
Jul 27 21:09:04.268258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:04.268148    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e77d321b602f48e95f4a3bc1bfcee272a40a225c5e8f1cd00e30ca648a0b016e"
Jul 27 21:09:05.406123 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.406103    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:05.572885 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.572826    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqnnw\" (UniqueName: \"kubernetes.io/projected/a8793dcb-2bbd-4081-968d-33373ba6e839-kube-api-access-vqnnw\") pod \"a8793dcb-2bbd-4081-968d-33373ba6e839\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") "
Jul 27 21:09:05.572885 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.572873    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-bundle\") pod \"a8793dcb-2bbd-4081-968d-33373ba6e839\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") "
Jul 27 21:09:05.573026 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.572903    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-util\") pod \"a8793dcb-2bbd-4081-968d-33373ba6e839\" (UID: \"a8793dcb-2bbd-4081-968d-33373ba6e839\") "
Jul 27 21:09:05.573326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.573302    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-bundle" (OuterVolumeSpecName: "bundle") pod "a8793dcb-2bbd-4081-968d-33373ba6e839" (UID: "a8793dcb-2bbd-4081-968d-33373ba6e839"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:05.574996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.574970    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8793dcb-2bbd-4081-968d-33373ba6e839-kube-api-access-vqnnw" (OuterVolumeSpecName: "kube-api-access-vqnnw") pod "a8793dcb-2bbd-4081-968d-33373ba6e839" (UID: "a8793dcb-2bbd-4081-968d-33373ba6e839"). InnerVolumeSpecName "kube-api-access-vqnnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:05.578553 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.578522    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-util" (OuterVolumeSpecName: "util") pod "a8793dcb-2bbd-4081-968d-33373ba6e839" (UID: "a8793dcb-2bbd-4081-968d-33373ba6e839"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:05.673354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.673332    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqnnw\" (UniqueName: \"kubernetes.io/projected/a8793dcb-2bbd-4081-968d-33373ba6e839-kube-api-access-vqnnw\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:05.673354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.673352    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:05.673466 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:05.673361    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8793dcb-2bbd-4081-968d-33373ba6e839-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:06.287240 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:06.287211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg" event={"ID":"a8793dcb-2bbd-4081-968d-33373ba6e839","Type":"ContainerDied","Data":"9b78da373df9ad1534917f36083b704318545cf7207a5cfeefe9a037b30a6a01"}
Jul 27 21:09:06.287362 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:06.287251    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg"
Jul 27 21:09:06.287362 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:06.287284    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b78da373df9ad1534917f36083b704318545cf7207a5cfeefe9a037b30a6a01"
Jul 27 21:09:11.735699 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:11.735663    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:15.209420 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:15.209379    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:16.362095 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:16.362063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:16.507208 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:16.507176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:17.188020 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:17.187984    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:19.057792 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:19.057763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:19.156061 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:19.156032    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:21.393191 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:21.393151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:21.527788 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:21.527758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:22.371695 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:22.371661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:23.778040 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:23.778007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:23.862830 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:23.862798    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:25.884663 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:25.884569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:26.159921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:26.159852    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:26.732231 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:26.732195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:26.791409 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:26.791385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:26.971756 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:26.971720    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575df745c9-tgxq6"]
Jul 27 21:09:27.101492 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:27.101457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:27.202231 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:27.202207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:27.302571 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:27.302549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:34.405681 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:34.405650    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:34.505958 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:34.505933    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:39.174467 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:39.174427    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:39.275397 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:39.275365    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:43.749336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:43.749278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:43.849253 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:43.849225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:43.958190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:43.958166    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:44.049306 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:44.049280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:48.149394 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:48.149359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:48.250243 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:48.250214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:51.990917 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:51.990851    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-575df745c9-tgxq6" podUID="1e325720-8990-490c-ae3f-6641f1615c68" containerName="console" containerID="cri-o://64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01" gracePeriod=15
Jul 27 21:09:52.245851 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.245799    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:09:52.342841 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.342809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-console-config\") pod \"1e325720-8990-490c-ae3f-6641f1615c68\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") "
Jul 27 21:09:52.342999 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.342852    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-trusted-ca-bundle\") pod \"1e325720-8990-490c-ae3f-6641f1615c68\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") "
Jul 27 21:09:52.343068 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343012    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-serving-cert\") pod \"1e325720-8990-490c-ae3f-6641f1615c68\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") "
Jul 27 21:09:52.343068 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343051    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-oauth-config\") pod \"1e325720-8990-490c-ae3f-6641f1615c68\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") "
Jul 27 21:09:52.343180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343090    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4l68\" (UniqueName: \"kubernetes.io/projected/1e325720-8990-490c-ae3f-6641f1615c68-kube-api-access-g4l68\") pod \"1e325720-8990-490c-ae3f-6641f1615c68\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") "
Jul 27 21:09:52.343180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343113    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-service-ca\") pod \"1e325720-8990-490c-ae3f-6641f1615c68\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") "
Jul 27 21:09:52.343180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-oauth-serving-cert\") pod \"1e325720-8990-490c-ae3f-6641f1615c68\" (UID: \"1e325720-8990-490c-ae3f-6641f1615c68\") "
Jul 27 21:09:52.343360 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343328    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1e325720-8990-490c-ae3f-6641f1615c68" (UID: "1e325720-8990-490c-ae3f-6641f1615c68"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:09:52.343427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343368    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-console-config" (OuterVolumeSpecName: "console-config") pod "1e325720-8990-490c-ae3f-6641f1615c68" (UID: "1e325720-8990-490c-ae3f-6641f1615c68"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:09:52.343646 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343592    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-console-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.343646 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343653    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-trusted-ca-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.343825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343734    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1e325720-8990-490c-ae3f-6641f1615c68" (UID: "1e325720-8990-490c-ae3f-6641f1615c68"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:09:52.343825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.343762    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-service-ca" (OuterVolumeSpecName: "service-ca") pod "1e325720-8990-490c-ae3f-6641f1615c68" (UID: "1e325720-8990-490c-ae3f-6641f1615c68"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:09:52.345417 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.345392    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1e325720-8990-490c-ae3f-6641f1615c68" (UID: "1e325720-8990-490c-ae3f-6641f1615c68"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:09:52.345526 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.345511    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1e325720-8990-490c-ae3f-6641f1615c68" (UID: "1e325720-8990-490c-ae3f-6641f1615c68"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:09:52.345574 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.345549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e325720-8990-490c-ae3f-6641f1615c68-kube-api-access-g4l68" (OuterVolumeSpecName: "kube-api-access-g4l68") pod "1e325720-8990-490c-ae3f-6641f1615c68" (UID: "1e325720-8990-490c-ae3f-6641f1615c68"). InnerVolumeSpecName "kube-api-access-g4l68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:52.445008 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.444981    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.445008 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.445006    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e325720-8990-490c-ae3f-6641f1615c68-console-oauth-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.445156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.445020    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4l68\" (UniqueName: \"kubernetes.io/projected/1e325720-8990-490c-ae3f-6641f1615c68-kube-api-access-g4l68\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.445156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.445033    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.445156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.445045    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e325720-8990-490c-ae3f-6641f1615c68-oauth-serving-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.522160 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.522132    2579 generic.go:356] "Generic (PLEG): container finished" podID="1e325720-8990-490c-ae3f-6641f1615c68" containerID="64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01" exitCode=0
Jul 27 21:09:52.522280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.522167    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575df745c9-tgxq6"
Jul 27 21:09:52.522280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.522219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575df745c9-tgxq6" event={"ID":"1e325720-8990-490c-ae3f-6641f1615c68","Type":"ContainerDied","Data":"64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01"}
Jul 27 21:09:52.522280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.522271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575df745c9-tgxq6" event={"ID":"1e325720-8990-490c-ae3f-6641f1615c68","Type":"ContainerDied","Data":"e2fd4c95386bc759b70e7ba6418303f3334df985e283537cb8a07b3ee8149fc2"}
Jul 27 21:09:52.522509 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.522298    2579 scope.go:117] "RemoveContainer" containerID="64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01"
Jul 27 21:09:52.531486 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.531387    2579 scope.go:117] "RemoveContainer" containerID="64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01"
Jul 27 21:09:52.531715 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:09:52.531697    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01\": container with ID starting with 64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01 not found: ID does not exist" containerID="64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01"
Jul 27 21:09:52.531769 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.531721    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01"} err="failed to get container status \"64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01\": rpc error: code = NotFound desc = could not find container \"64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01\": container with ID starting with 64f558b1839200689251b8ecfc411603433b13d9a12200e2904a2c3d50a9ee01 not found: ID does not exist"
Jul 27 21:09:52.545464 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.545444    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575df745c9-tgxq6"]
Jul 27 21:09:52.554205 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:52.554185    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-575df745c9-tgxq6"]
Jul 27 21:09:54.390452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:54.390417    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e325720-8990-490c-ae3f-6641f1615c68" path="/var/lib/kubelet/pods/1e325720-8990-490c-ae3f-6641f1615c68/volumes"
Jul 27 21:09:55.360156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:55.360120    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:55.459416 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:55.459368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:59.577323 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:59.577276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:59.672930 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:09:59.672900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:04.369949 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:04.369903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:04.475318 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:04.475286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:25.380431 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:25.380392    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:25.444947 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:25.444916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:27.374587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.374559    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:27.473902 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.473869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:27.571834 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.571800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:27.752436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752345    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:10:27.752819 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752801    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerName="util"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752823    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerName="util"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752837    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerName="pull"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752844    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerName="pull"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752857    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e325720-8990-490c-ae3f-6641f1615c68" containerName="console"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752866    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e325720-8990-490c-ae3f-6641f1615c68" containerName="console"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752879    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerName="extract"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752887    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerName="extract"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752902    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerName="util"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752909    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerName="util"
Jul 27 21:10:27.752921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752921    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752930    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752947    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerName="util"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752956    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerName="util"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752974    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerName="pull"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752982    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerName="pull"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.752994    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerName="util"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753003    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerName="util"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753012    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753020    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753032    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753039    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753054    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerName="pull"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753068    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerName="pull"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753078    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerName="pull"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753087    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerName="pull"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753180    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e325720-8990-490c-ae3f-6641f1615c68" containerName="console"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753195    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6d9379-020d-4568-8285-ccd4e64d7f23" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753205    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="93869c16-e3ab-4f23-aa26-25e99de5e5d4" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753215    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8793dcb-2bbd-4081-968d-33373ba6e839" containerName="extract"
Jul 27 21:10:27.753429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.753228    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b57081e-f576-4d2c-83d4-a2c880abfa83" containerName="extract"
Jul 27 21:10:27.756934 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.756916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:27.759385 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.759369    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lljbj\""
Jul 27 21:10:27.759549 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.759531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 21:10:27.760190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.760176    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 21:10:27.760256 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.760179    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 21:10:27.767731 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.767711    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:10:27.793769 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.793739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:10:27.831665 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.831641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24hs9\" (UniqueName: \"kubernetes.io/projected/9f382f80-42f9-435c-b806-d87bdcb0b997-kube-api-access-24hs9\") pod \"limitador-limitador-54d6d988d5-t82x4\" (UID: \"9f382f80-42f9-435c-b806-d87bdcb0b997\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:27.831799 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.831709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f382f80-42f9-435c-b806-d87bdcb0b997-config-file\") pod \"limitador-limitador-54d6d988d5-t82x4\" (UID: \"9f382f80-42f9-435c-b806-d87bdcb0b997\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:27.933170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.933136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f382f80-42f9-435c-b806-d87bdcb0b997-config-file\") pod \"limitador-limitador-54d6d988d5-t82x4\" (UID: \"9f382f80-42f9-435c-b806-d87bdcb0b997\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:27.933337 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.933196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24hs9\" (UniqueName: \"kubernetes.io/projected/9f382f80-42f9-435c-b806-d87bdcb0b997-kube-api-access-24hs9\") pod \"limitador-limitador-54d6d988d5-t82x4\" (UID: \"9f382f80-42f9-435c-b806-d87bdcb0b997\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:27.933782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.933765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f382f80-42f9-435c-b806-d87bdcb0b997-config-file\") pod \"limitador-limitador-54d6d988d5-t82x4\" (UID: \"9f382f80-42f9-435c-b806-d87bdcb0b997\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:27.940979 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:27.940951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24hs9\" (UniqueName: \"kubernetes.io/projected/9f382f80-42f9-435c-b806-d87bdcb0b997-kube-api-access-24hs9\") pod \"limitador-limitador-54d6d988d5-t82x4\" (UID: \"9f382f80-42f9-435c-b806-d87bdcb0b997\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:28.068043 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:28.068015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:28.204885 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:28.204861    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:10:28.207008 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:10:28.206981    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f382f80_42f9_435c_b806_d87bdcb0b997.slice/crio-e65e8f1899e4c0cabaad91c0b7d72f8ebf80e1c8bbd70481cae582a6f2e2b1ce WatchSource:0}: Error finding container e65e8f1899e4c0cabaad91c0b7d72f8ebf80e1c8bbd70481cae582a6f2e2b1ce: Status 404 returned error can't find the container with id e65e8f1899e4c0cabaad91c0b7d72f8ebf80e1c8bbd70481cae582a6f2e2b1ce
Jul 27 21:10:28.208256 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:28.208230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:28.271201 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:28.271149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:28.710184 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:28.710098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4" event={"ID":"9f382f80-42f9-435c-b806-d87bdcb0b997","Type":"ContainerStarted","Data":"e65e8f1899e4c0cabaad91c0b7d72f8ebf80e1c8bbd70481cae582a6f2e2b1ce"}
Jul 27 21:10:31.729222 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:31.729188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4" event={"ID":"9f382f80-42f9-435c-b806-d87bdcb0b997","Type":"ContainerStarted","Data":"ddf650c42833bd9dd41be812cd1b491efb644da30a9a2b4df7cf57a8b4bd8443"}
Jul 27 21:10:31.729642 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:31.729250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:31.747179 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:31.747130    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4" podStartSLOduration=2.248779841 podStartE2EDuration="4.747114676s" totalImagesPullingTime="2.498334835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:31.744649323 +0000 UTC m=+777.905039684" watchObservedRunningTime="2026-07-27 21:10:31.747114676 +0000 UTC m=+777.907505034"
Jul 27 21:10:42.735982 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:42.735945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t82x4"
Jul 27 21:10:48.572095 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:48.572064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:48.673335 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:48.673302    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:49.179895 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:10:49.179855    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:01.733415 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:01.733330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:01.915924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:01.915891    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:08.406791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:08.406759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:08.505914 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:08.505880    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:08.607401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:08.607360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:08.859755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:08.859724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:12.227043 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:12.227004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:12.319948 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:12.319922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:20.802762 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:20.802726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:20.903003 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:20.902968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:26.862558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:26.862513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:36.086770 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:36.086724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:43.945366 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:43.945317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:44.053205 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:44.053173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:44.519291 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:44.519253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:44.808021 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:44.807940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:45.136572 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:45.136491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:45.239970 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:45.239944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:45.367009 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:45.366978    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:11:55.438859 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:55.438823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:55.538312 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:11:55.538275    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:11.100107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:11.100066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:11.545088 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:11.545058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:12:31.701174 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.701142    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"]
Jul 27 21:12:31.704831 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.704805    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.708187 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.708162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 21:12:31.708326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.708206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b6v8k\""
Jul 27 21:12:31.708326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.708210    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 21:12:31.708326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.708290    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 21:12:31.714365 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.714345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"]
Jul 27 21:12:31.740543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.740515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:31.741644 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.741623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7bg7\" (UniqueName: \"kubernetes.io/projected/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-kube-api-access-t7bg7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.741724 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.741677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.741724 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.741712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.741800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.741728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.741800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.741764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.741866 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.741809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842363 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842703 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7bg7\" (UniqueName: \"kubernetes.io/projected/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-kube-api-access-t7bg7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842786 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842849 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.842904 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.842861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.844877 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.844858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.844990 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.844975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:31.850756 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:31.850734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7bg7\" (UniqueName: \"kubernetes.io/projected/2f5105ca-eda3-4936-96cb-6dc54d0e04f2-kube-api-access-t7bg7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4cx8\" (UID: \"2f5105ca-eda3-4936-96cb-6dc54d0e04f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:32.015501 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:32.015428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:32.147541 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:32.147515    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"]
Jul 27 21:12:32.149310 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:12:32.149275    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5105ca_eda3_4936_96cb_6dc54d0e04f2.slice/crio-8b7895d5aee7c92077b4139ba0db558ee8c3daf960a30484a8e1bd2ff0a82af1 WatchSource:0}: Error finding container 8b7895d5aee7c92077b4139ba0db558ee8c3daf960a30484a8e1bd2ff0a82af1: Status 404 returned error can't find the container with id 8b7895d5aee7c92077b4139ba0db558ee8c3daf960a30484a8e1bd2ff0a82af1
Jul 27 21:12:32.367508 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:32.367472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8" event={"ID":"2f5105ca-eda3-4936-96cb-6dc54d0e04f2","Type":"ContainerStarted","Data":"8b7895d5aee7c92077b4139ba0db558ee8c3daf960a30484a8e1bd2ff0a82af1"}
Jul 27 21:12:32.540680 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:32.540642    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:12:33.373736 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:33.373653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8" event={"ID":"2f5105ca-eda3-4936-96cb-6dc54d0e04f2","Type":"ContainerStarted","Data":"a35244fec9eed3a1d3f1d6e9b98c6255efc04e63a76d7cec444de3bfe65021cd"}
Jul 27 21:12:33.391117 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:33.391068    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8" podStartSLOduration=1.454649012 podStartE2EDuration="2.391053012s" totalImagesPullingTime="936.404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:12:33.389069859 +0000 UTC m=+899.549460217" watchObservedRunningTime="2026-07-27 21:12:33.391053012 +0000 UTC m=+899.551443368"
Jul 27 21:12:34.333727 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:34.333701    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:12:34.333949 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:34.333929    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:12:37.216206 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:37.216171    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:38.348782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:38.348750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:12:42.016084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:42.016047    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:42.016547 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:42.016117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:42.028286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:42.028259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:42.432203 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:42.432170    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4cx8"
Jul 27 21:12:54.825524 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:54.825485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:56.263095 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:56.263068    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:12:56.326319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:12:56.326286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:15.682499 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:13:15.682465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:17.644036 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:13:17.644000    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:13:19.878309 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:13:19.878256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:20.597515 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:13:20.597485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:29.750433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:13:29.750397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:13:38.371690 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:13:38.371645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:04.999324 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:14:04.999293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:05.093611 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:14:05.093558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:06.176654 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:14:06.176618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:06.417276 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:14:06.417242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:35.454076 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:14:35.454039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:14:45.446198 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:14:45.446150    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:14:55.748916 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:14:55.748885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:15:00.144896 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:00.144862    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl"]
Jul 27 21:15:00.148172 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:00.148152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl"
Jul 27 21:15:00.150350 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:00.150329    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:15:00.155246 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:00.155223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl"]
Jul 27 21:15:00.159292 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:00.159276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl"
Jul 27 21:15:00.294435 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:00.294404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl"]
Jul 27 21:15:00.296620 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:15:00.296578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf762903_ceee_456f_af91_df4ee989f57c.slice/crio-4eb71cc3f7dca6dc4e8daab6e7ab990da1721db5e90f4cc29cf59fe5b8807286 WatchSource:0}: Error finding container 4eb71cc3f7dca6dc4e8daab6e7ab990da1721db5e90f4cc29cf59fe5b8807286: Status 404 returned error can't find the container with id 4eb71cc3f7dca6dc4e8daab6e7ab990da1721db5e90f4cc29cf59fe5b8807286
Jul 27 21:15:00.299103 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:00.299086    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:15:01.148073 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:01.148038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl" event={"ID":"bf762903-ceee-456f-af91-df4ee989f57c","Type":"ContainerStarted","Data":"4eb71cc3f7dca6dc4e8daab6e7ab990da1721db5e90f4cc29cf59fe5b8807286"}
Jul 27 21:15:04.166658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:04.166628    2579 generic.go:356] "Generic (PLEG): container finished" podID="bf762903-ceee-456f-af91-df4ee989f57c" containerID="034ff4518743135d042a2cda1a9890a4de204b970c2cdbd0499acab1a38ad57f" exitCode=0
Jul 27 21:15:04.166991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:04.166732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl" event={"ID":"bf762903-ceee-456f-af91-df4ee989f57c","Type":"ContainerDied","Data":"034ff4518743135d042a2cda1a9890a4de204b970c2cdbd0499acab1a38ad57f"}
Jul 27 21:15:05.305294 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:05.305265    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl"
Jul 27 21:15:06.177583 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:06.177551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl"
Jul 27 21:15:06.177784 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:06.177625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753115-drdcl" event={"ID":"bf762903-ceee-456f-af91-df4ee989f57c","Type":"ContainerDied","Data":"4eb71cc3f7dca6dc4e8daab6e7ab990da1721db5e90f4cc29cf59fe5b8807286"}
Jul 27 21:15:06.177784 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:15:06.177667    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eb71cc3f7dca6dc4e8daab6e7ab990da1721db5e90f4cc29cf59fe5b8807286"
Jul 27 21:16:11.575743 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:16:11.575699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:16:12.769649 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:16:12.769585    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:16:36.648594 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:16:36.648557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:16:51.343052 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:16:51.343015    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:16:51.678269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:16:51.678191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:00.849329 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:00.849238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:00.956870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:00.956829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:01.119436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:01.119352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:07.222269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:07.222231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:07.298766 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:07.298738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:07.400816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:07.400776    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:07.503848 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:07.503766    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:07.601769 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:07.601740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:13.350923 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:13.350887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:13.451103 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:13.451068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:16.322042 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:16.322011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:16.423183 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:16.423145    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:30.368282 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:30.368249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:17:34.371441 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:34.371413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:17:34.373051 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:34.373028    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:17:40.040237 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:40.040209    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:17:41.024377 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:41.024340    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:49.048029 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:49.047992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:17:57.847670 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:17:57.847633    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:18:08.162677 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:18:08.162631    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:18:16.954214 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:18:16.954173    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:18:28.955911 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:18:28.955822    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:18:38.647256 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:18:38.647220    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:19:01.457461 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:19:01.457418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:19:13.451632 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:19:13.451588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:19:37.247216 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:19:37.247177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:19:47.149564 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:19:47.149533    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:20:03.048676 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:20:03.048579    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:20:13.942382 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:20:13.942346    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:20:23.346980 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:20:23.346950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:20:32.243340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:20:32.243306    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:20:42.253107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:20:42.253074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:21:09.262026 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:21:09.261990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:21:45.968000 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:21:45.967915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:21:46.024453 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:21:46.024422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:22:31.456612 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:22:31.456563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:22:34.409498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:22:34.409472    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:22:34.412818 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:22:34.412796    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:22:40.147329 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:22:40.147205    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:22:54.957955 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:22:54.957879    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:23:04.656618 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:23:04.656579    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:23:15.558657 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:23:15.558619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:23:27.058448 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:23:27.058412    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:23:34.824723 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:23:34.824693    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:35.959612 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:23:35.959575    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:23:45.858621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:23:45.858569    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:23:58.262413 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:23:58.262373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:24:07.353245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:24:07.353209    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:24:17.465104 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:24:17.465066    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:24:41.864202 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:24:41.864127    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:24:49.368076 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:24:49.368034    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:24:56.947121 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:24:56.947088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:00.054901 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:00.054870    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:25:01.291553 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.291518    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"]
Jul 27 21:25:01.291935 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.291879    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf762903-ceee-456f-af91-df4ee989f57c" containerName="cleanup"
Jul 27 21:25:01.291935 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.291891    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf762903-ceee-456f-af91-df4ee989f57c" containerName="cleanup"
Jul 27 21:25:01.292011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.291973    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf762903-ceee-456f-af91-df4ee989f57c" containerName="cleanup"
Jul 27 21:25:01.295073 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.295054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.298744 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.298724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4fc98703-kserve-self-signed-certs\""
Jul 27 21:25:01.307806 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.307789    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"]
Jul 27 21:25:01.335835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.335811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:01.371155 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.371130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-model-cache\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.371288 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.371177    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-home\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.371288 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.371260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nd9\" (UniqueName: \"kubernetes.io/projected/d0521362-fff1-424c-a003-f342a23b7e50-kube-api-access-w9nd9\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.371401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.371322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-tmp-dir\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.371456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.371425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0521362-fff1-424c-a003-f342a23b7e50-tls-certs\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.371495 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.371459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-dshm\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.471965 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.471939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0521362-fff1-424c-a003-f342a23b7e50-tls-certs\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.471965 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.471967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-dshm\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.472127 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.471997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-model-cache\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.472174 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.472121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-home\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.472174 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.472155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nd9\" (UniqueName: \"kubernetes.io/projected/d0521362-fff1-424c-a003-f342a23b7e50-kube-api-access-w9nd9\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.472280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.472187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-tmp-dir\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.472402 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.472382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-model-cache\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.472486 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.472465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-home\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.472556 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.472539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-tmp-dir\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.474370 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.474348    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-dshm\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.474614 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.474587    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0521362-fff1-424c-a003-f342a23b7e50-tls-certs\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.480533 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.480511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nd9\" (UniqueName: \"kubernetes.io/projected/d0521362-fff1-424c-a003-f342a23b7e50-kube-api-access-w9nd9\") pod \"e2e-same-id-b-4fc98703-kserve-678756b7f-ff492\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") " pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.604427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.604359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:01.752043 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:01.752016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"]
Jul 27 21:25:01.753594 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:25:01.753557    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0521362_fff1_424c_a003_f342a23b7e50.slice/crio-24566b4e161062cf4364705507317a01c90befe5268a043f53c8bba841b1947d WatchSource:0}: Error finding container 24566b4e161062cf4364705507317a01c90befe5268a043f53c8bba841b1947d: Status 404 returned error can't find the container with id 24566b4e161062cf4364705507317a01c90befe5268a043f53c8bba841b1947d
Jul 27 21:25:02.348825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:02.348786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492" event={"ID":"d0521362-fff1-424c-a003-f342a23b7e50","Type":"ContainerStarted","Data":"4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb"}
Jul 27 21:25:02.348825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:02.348831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492" event={"ID":"d0521362-fff1-424c-a003-f342a23b7e50","Type":"ContainerStarted","Data":"24566b4e161062cf4364705507317a01c90befe5268a043f53c8bba841b1947d"}
Jul 27 21:25:02.371011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:02.370962    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492" podStartSLOduration=1.370945657 podStartE2EDuration="1.370945657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:25:02.368304861 +0000 UTC m=+1648.528695222" watchObservedRunningTime="2026-07-27 21:25:02.370945657 +0000 UTC m=+1648.531336024"
Jul 27 21:25:11.604529 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:11.604489    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:11.604995 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:11.604544    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:11.617674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:11.617643    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:12.413027 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:12.412995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:14.159091 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:14.159053    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:25:35.235357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:35.235320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:36.347280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:36.347245    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"]
Jul 27 21:25:36.379652 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:36.379627    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:38.657741 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:38.657712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:25:51.357127 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.357087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:25:51.366650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.366569    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492" podUID="d0521362-fff1-424c-a003-f342a23b7e50" containerName="main" containerID="cri-o://4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb" gracePeriod=45
Jul 27 21:25:51.614646 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.614580    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:51.623223 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.623195    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0521362-fff1-424c-a003-f342a23b7e50" containerID="4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb" exitCode=0
Jul 27 21:25:51.623338 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.623234    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"
Jul 27 21:25:51.623338 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.623249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492" event={"ID":"d0521362-fff1-424c-a003-f342a23b7e50","Type":"ContainerDied","Data":"4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb"}
Jul 27 21:25:51.623338 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.623288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492" event={"ID":"d0521362-fff1-424c-a003-f342a23b7e50","Type":"ContainerDied","Data":"24566b4e161062cf4364705507317a01c90befe5268a043f53c8bba841b1947d"}
Jul 27 21:25:51.623338 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.623311    2579 scope.go:117] "RemoveContainer" containerID="4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb"
Jul 27 21:25:51.633302 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.633288    2579 scope.go:117] "RemoveContainer" containerID="4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb"
Jul 27 21:25:51.633534 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:25:51.633515    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb\": container with ID starting with 4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb not found: ID does not exist" containerID="4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb"
Jul 27 21:25:51.633637 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.633546    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb"} err="failed to get container status \"4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb\": rpc error: code = NotFound desc = could not find container \"4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb\": container with ID starting with 4f7a59c4ba4c4fb624000f132c39e95b827a512ea3ceea089bf2cab11cc44edb not found: ID does not exist"
Jul 27 21:25:51.674299 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-model-cache\") pod \"d0521362-fff1-424c-a003-f342a23b7e50\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") "
Jul 27 21:25:51.674406 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674356    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9nd9\" (UniqueName: \"kubernetes.io/projected/d0521362-fff1-424c-a003-f342a23b7e50-kube-api-access-w9nd9\") pod \"d0521362-fff1-424c-a003-f342a23b7e50\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") "
Jul 27 21:25:51.674448 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-home\") pod \"d0521362-fff1-424c-a003-f342a23b7e50\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") "
Jul 27 21:25:51.674448 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-tmp-dir\") pod \"d0521362-fff1-424c-a003-f342a23b7e50\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") "
Jul 27 21:25:51.674517 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674476    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-dshm\") pod \"d0521362-fff1-424c-a003-f342a23b7e50\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") "
Jul 27 21:25:51.674517 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674477    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0521362-fff1-424c-a003-f342a23b7e50" (UID: "d0521362-fff1-424c-a003-f342a23b7e50"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:51.674580 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0521362-fff1-424c-a003-f342a23b7e50-tls-certs\") pod \"d0521362-fff1-424c-a003-f342a23b7e50\" (UID: \"d0521362-fff1-424c-a003-f342a23b7e50\") "
Jul 27 21:25:51.674758 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674733    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0521362-fff1-424c-a003-f342a23b7e50" (UID: "d0521362-fff1-424c-a003-f342a23b7e50"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:51.674860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674740    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-home" (OuterVolumeSpecName: "home") pod "d0521362-fff1-424c-a003-f342a23b7e50" (UID: "d0521362-fff1-424c-a003-f342a23b7e50"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:51.674860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674854    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-home\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:25:51.674946 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674870    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-tmp-dir\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:25:51.674946 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.674880    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-model-cache\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:25:51.676559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.676538    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0521362-fff1-424c-a003-f342a23b7e50-kube-api-access-w9nd9" (OuterVolumeSpecName: "kube-api-access-w9nd9") pod "d0521362-fff1-424c-a003-f342a23b7e50" (UID: "d0521362-fff1-424c-a003-f342a23b7e50"). InnerVolumeSpecName "kube-api-access-w9nd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:51.676658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.676593    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0521362-fff1-424c-a003-f342a23b7e50-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0521362-fff1-424c-a003-f342a23b7e50" (UID: "d0521362-fff1-424c-a003-f342a23b7e50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:25:51.676658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.676643    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-dshm" (OuterVolumeSpecName: "dshm") pod "d0521362-fff1-424c-a003-f342a23b7e50" (UID: "d0521362-fff1-424c-a003-f342a23b7e50"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:51.775755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.775730    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9nd9\" (UniqueName: \"kubernetes.io/projected/d0521362-fff1-424c-a003-f342a23b7e50-kube-api-access-w9nd9\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:25:51.775755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.775752    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0521362-fff1-424c-a003-f342a23b7e50-dshm\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:25:51.775879 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.775761    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0521362-fff1-424c-a003-f342a23b7e50-tls-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:25:51.947955 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.947921    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"]
Jul 27 21:25:51.951389 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:51.951363    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4fc98703-kserve-678756b7f-ff492"]
Jul 27 21:25:52.388922 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:52.388889    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0521362-fff1-424c-a003-f342a23b7e50" path="/var/lib/kubelet/pods/d0521362-fff1-424c-a003-f342a23b7e50/volumes"
Jul 27 21:25:57.958055 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:25:57.957970    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:26:12.955036 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:26:12.955000    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:26:22.350921 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:26:22.350881    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:26:31.564103 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:26:31.564062    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:26:40.049875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:26:40.049834    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:26:51.255577 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:26:51.255539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:27:02.649133 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:02.649096    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:27:15.361659 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:15.361624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:27:24.662724 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:24.662646    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:27:33.965089 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:33.965049    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:27:34.445565 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:34.445535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:27:34.449247 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:34.449226    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:27:44.854218 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:44.854188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:27:57.149806 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:27:57.149774    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:28:00.111655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:00.111625    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:01.560569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:01.560534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:04.651911 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:04.651877    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:28:17.953543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:17.953508    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:28:29.650897 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:29.650858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:28:41.065580 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:41.065540    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:28:43.746278 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:43.746240    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:52.311414 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:52.311376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:52.374045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:52.374009    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:55.005576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:28:55.005500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:29:04.282215 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:04.282173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:04.749298 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:04.749215    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:29:05.387019 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:05.386989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:08.735459 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:08.735421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:08.829956 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:08.829931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:09.236714 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:09.236688    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:14.453054 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:14.453022    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:29:15.346509 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:15.346464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:15.443047 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:15.443017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:15.601521 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:15.601449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:15.973116 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:15.973015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:16.175422 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:16.175393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:18.465074 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:18.465039    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:18.570801 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:18.570769    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:18.671038 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:18.670996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:18.850357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:18.850322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:19.297532 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.297504    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:19.388888 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.388848    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:19.415491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.415462    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"]
Jul 27 21:29:19.415882 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.415868    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0521362-fff1-424c-a003-f342a23b7e50" containerName="main"
Jul 27 21:29:19.415946 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.415884    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0521362-fff1-424c-a003-f342a23b7e50" containerName="main"
Jul 27 21:29:19.415983 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.415959    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0521362-fff1-424c-a003-f342a23b7e50" containerName="main"
Jul 27 21:29:19.418815 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.418799    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.421265 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.421247    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-de98b5e8\""
Jul 27 21:29:19.432231 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.432206    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"]
Jul 27 21:29:19.528916 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.528890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckcjl\" (UniqueName: \"kubernetes.io/projected/d20133bc-a804-42e9-90c4-dc41b154cb31-kube-api-access-ckcjl\") pod \"payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") " pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.529192 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.528966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d20133bc-a804-42e9-90c4-dc41b154cb31-plugins-config-volume\") pod \"payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") " pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.629545 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.629472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d20133bc-a804-42e9-90c4-dc41b154cb31-plugins-config-volume\") pod \"payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") " pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.629688 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.629559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckcjl\" (UniqueName: \"kubernetes.io/projected/d20133bc-a804-42e9-90c4-dc41b154cb31-kube-api-access-ckcjl\") pod \"payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") " pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.630218 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.630200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d20133bc-a804-42e9-90c4-dc41b154cb31-plugins-config-volume\") pod \"payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") " pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.638851 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.638823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckcjl\" (UniqueName: \"kubernetes.io/projected/d20133bc-a804-42e9-90c4-dc41b154cb31-kube-api-access-ckcjl\") pod \"payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") " pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.729202 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.729180    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:19.869404 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.868554    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"]
Jul 27 21:29:19.871078 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:29:19.871043    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20133bc_a804_42e9_90c4_dc41b154cb31.slice/crio-2c616d080e822ff17f281f47f8398f009afbf05f45a710fb2aac92e3d5a3e62c WatchSource:0}: Error finding container 2c616d080e822ff17f281f47f8398f009afbf05f45a710fb2aac92e3d5a3e62c: Status 404 returned error can't find the container with id 2c616d080e822ff17f281f47f8398f009afbf05f45a710fb2aac92e3d5a3e62c
Jul 27 21:29:19.873450 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:19.873433    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:29:20.738040 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:20.737968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt" event={"ID":"d20133bc-a804-42e9-90c4-dc41b154cb31","Type":"ContainerStarted","Data":"2c616d080e822ff17f281f47f8398f009afbf05f45a710fb2aac92e3d5a3e62c"}
Jul 27 21:29:21.744687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:21.744581    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt" event={"ID":"d20133bc-a804-42e9-90c4-dc41b154cb31","Type":"ContainerStarted","Data":"261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a"}
Jul 27 21:29:21.744687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:21.744677    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:21.775541 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:21.775498    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt" podStartSLOduration=1.155476305 podStartE2EDuration="2.775484279s" totalImagesPullingTime="1.620007974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:21.77485288 +0000 UTC m=+1907.935243261" watchObservedRunningTime="2026-07-27 21:29:21.775484279 +0000 UTC m=+1907.935874637"
Jul 27 21:29:23.860081 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:23.860045    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:29:32.751983 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:32.751950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:44.189552 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.189522    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"]
Jul 27 21:29:44.193280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.193265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"
Jul 27 21:29:44.195883 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.195860    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:29:44.196344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.196327    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:29:44.203144 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.203120    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"]
Jul 27 21:29:44.329927 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.329900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32acca43-aebd-4be6-ae19-a02c2c4b7930-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p\" (UID: \"32acca43-aebd-4be6-ae19-a02c2c4b7930\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"
Jul 27 21:29:44.431164 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.431139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32acca43-aebd-4be6-ae19-a02c2c4b7930-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p\" (UID: \"32acca43-aebd-4be6-ae19-a02c2c4b7930\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"
Jul 27 21:29:44.431694 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.431678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32acca43-aebd-4be6-ae19-a02c2c4b7930-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p\" (UID: \"32acca43-aebd-4be6-ae19-a02c2c4b7930\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"
Jul 27 21:29:44.504264 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.504208    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"
Jul 27 21:29:44.638439 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.638415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"]
Jul 27 21:29:44.640057 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:29:44.640027    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32acca43_aebd_4be6_ae19_a02c2c4b7930.slice/crio-efa00e3ea6d0eea65bbf41466fe6e9eabb0cbec78c7e93091f46bc42141713cf WatchSource:0}: Error finding container efa00e3ea6d0eea65bbf41466fe6e9eabb0cbec78c7e93091f46bc42141713cf: Status 404 returned error can't find the container with id efa00e3ea6d0eea65bbf41466fe6e9eabb0cbec78c7e93091f46bc42141713cf
Jul 27 21:29:44.867397 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:44.867369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p" event={"ID":"32acca43-aebd-4be6-ae19-a02c2c4b7930","Type":"ContainerStarted","Data":"efa00e3ea6d0eea65bbf41466fe6e9eabb0cbec78c7e93091f46bc42141713cf"}
Jul 27 21:29:45.879937 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:45.879911    2579 generic.go:356] "Generic (PLEG): container finished" podID="32acca43-aebd-4be6-ae19-a02c2c4b7930" containerID="7dfda8b6d352e9ea1bcbf5afcaa85f8e7611d6c82b73b872562bc882b20ecd1d" exitCode=0
Jul 27 21:29:45.880310 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:45.880007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p" event={"ID":"32acca43-aebd-4be6-ae19-a02c2c4b7930","Type":"ContainerDied","Data":"7dfda8b6d352e9ea1bcbf5afcaa85f8e7611d6c82b73b872562bc882b20ecd1d"}
Jul 27 21:29:47.017533 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:47.017508    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"
Jul 27 21:29:47.151833 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:47.151750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32acca43-aebd-4be6-ae19-a02c2c4b7930-maas-api-service-ca\") pod \"32acca43-aebd-4be6-ae19-a02c2c4b7930\" (UID: \"32acca43-aebd-4be6-ae19-a02c2c4b7930\") "
Jul 27 21:29:47.152113 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:47.152092    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32acca43-aebd-4be6-ae19-a02c2c4b7930-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "32acca43-aebd-4be6-ae19-a02c2c4b7930" (UID: "32acca43-aebd-4be6-ae19-a02c2c4b7930"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:47.252563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:47.252535    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32acca43-aebd-4be6-ae19-a02c2c4b7930-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:29:47.891232 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:47.891205    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"
Jul 27 21:29:47.891392 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:47.891242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p" event={"ID":"32acca43-aebd-4be6-ae19-a02c2c4b7930","Type":"ContainerDied","Data":"efa00e3ea6d0eea65bbf41466fe6e9eabb0cbec78c7e93091f46bc42141713cf"}
Jul 27 21:29:47.891392 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:47.891282    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efa00e3ea6d0eea65bbf41466fe6e9eabb0cbec78c7e93091f46bc42141713cf"
Jul 27 21:29:54.839811 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:54.839776    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:54.859765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:54.859739    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"]
Jul 27 21:29:54.859987 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:54.859961    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt" podUID="d20133bc-a804-42e9-90c4-dc41b154cb31" containerName="payload-processing" containerID="cri-o://261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a" gracePeriod=30
Jul 27 21:29:54.949984 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:54.949944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:55.055957 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.055906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:55.100859 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.100754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"]
Jul 27 21:29:55.103331 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.103304    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de98b5e8-f5k5p"]
Jul 27 21:29:55.127839 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.127820    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:55.133859 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.133829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:55.289557 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.289524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:55.317582 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.317556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d20133bc-a804-42e9-90c4-dc41b154cb31-plugins-config-volume\") pod \"d20133bc-a804-42e9-90c4-dc41b154cb31\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") "
Jul 27 21:29:55.317739 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.317682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckcjl\" (UniqueName: \"kubernetes.io/projected/d20133bc-a804-42e9-90c4-dc41b154cb31-kube-api-access-ckcjl\") pod \"d20133bc-a804-42e9-90c4-dc41b154cb31\" (UID: \"d20133bc-a804-42e9-90c4-dc41b154cb31\") "
Jul 27 21:29:55.317912 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.317886    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20133bc-a804-42e9-90c4-dc41b154cb31-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d20133bc-a804-42e9-90c4-dc41b154cb31" (UID: "d20133bc-a804-42e9-90c4-dc41b154cb31"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:55.319916 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.319896    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20133bc-a804-42e9-90c4-dc41b154cb31-kube-api-access-ckcjl" (OuterVolumeSpecName: "kube-api-access-ckcjl") pod "d20133bc-a804-42e9-90c4-dc41b154cb31" (UID: "d20133bc-a804-42e9-90c4-dc41b154cb31"). InnerVolumeSpecName "kube-api-access-ckcjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:29:55.418632 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.418522    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d20133bc-a804-42e9-90c4-dc41b154cb31-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:29:55.418632 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.418549    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckcjl\" (UniqueName: \"kubernetes.io/projected/d20133bc-a804-42e9-90c4-dc41b154cb31-kube-api-access-ckcjl\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:29:55.530016 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.529987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:55.826324 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.826281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:55.925582 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.925553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:55.935184 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.935157    2579 generic.go:356] "Generic (PLEG): container finished" podID="d20133bc-a804-42e9-90c4-dc41b154cb31" containerID="261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a" exitCode=0
Jul 27 21:29:55.935320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.935203    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"
Jul 27 21:29:55.935320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.935246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt" event={"ID":"d20133bc-a804-42e9-90c4-dc41b154cb31","Type":"ContainerDied","Data":"261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a"}
Jul 27 21:29:55.935320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.935303    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt" event={"ID":"d20133bc-a804-42e9-90c4-dc41b154cb31","Type":"ContainerDied","Data":"2c616d080e822ff17f281f47f8398f009afbf05f45a710fb2aac92e3d5a3e62c"}
Jul 27 21:29:55.935499 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.935331    2579 scope.go:117] "RemoveContainer" containerID="261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a"
Jul 27 21:29:55.944891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.944877    2579 scope.go:117] "RemoveContainer" containerID="261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a"
Jul 27 21:29:55.945110 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:29:55.945092    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a\": container with ID starting with 261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a not found: ID does not exist" containerID="261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a"
Jul 27 21:29:55.945155 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.945117    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a"} err="failed to get container status \"261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a\": rpc error: code = NotFound desc = could not find container \"261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a\": container with ID starting with 261c6169077554b5452e89ea717e59782e013428e3dbbf381980ae06a639379a not found: ID does not exist"
Jul 27 21:29:55.957098 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.957079    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"]
Jul 27 21:29:55.961999 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:55.961978    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-de98b5e8-6479d77856-pn9gt"]
Jul 27 21:29:56.061941 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:56.061917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:56.389289 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:56.389260    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32acca43-aebd-4be6-ae19-a02c2c4b7930" path="/var/lib/kubelet/pods/32acca43-aebd-4be6-ae19-a02c2c4b7930/volumes"
Jul 27 21:29:56.389761 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:56.389744    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20133bc-a804-42e9-90c4-dc41b154cb31" path="/var/lib/kubelet/pods/d20133bc-a804-42e9-90c4-dc41b154cb31/volumes"
Jul 27 21:29:56.455282 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:56.455238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:56.575698 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:56.575668    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:58.758393 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.758365    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:29:58.919433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.919393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:58.994574 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.994543    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"]
Jul 27 21:29:58.994942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.994928    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32acca43-aebd-4be6-ae19-a02c2c4b7930" containerName="revoke-keys"
Jul 27 21:29:58.994942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.994943    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="32acca43-aebd-4be6-ae19-a02c2c4b7930" containerName="revoke-keys"
Jul 27 21:29:58.995060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.994952    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20133bc-a804-42e9-90c4-dc41b154cb31" containerName="payload-processing"
Jul 27 21:29:58.995060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.994958    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20133bc-a804-42e9-90c4-dc41b154cb31" containerName="payload-processing"
Jul 27 21:29:58.995060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.995014    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20133bc-a804-42e9-90c4-dc41b154cb31" containerName="payload-processing"
Jul 27 21:29:58.995060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.995023    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="32acca43-aebd-4be6-ae19-a02c2c4b7930" containerName="revoke-keys"
Jul 27 21:29:58.999183 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:58.999162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.002490 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.002468    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-3bb019f6-serving-cert\""
Jul 27 21:29:59.002490 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.002475    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:29:59.002677 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.002523    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 21:29:59.002677 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.002579    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gdtk\""
Jul 27 21:29:59.016094 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.016046    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"]
Jul 27 21:29:59.041024 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.040991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:59.045074 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.045053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.045172 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.045124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f62sn\" (UniqueName: \"kubernetes.io/projected/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-kube-api-access-f62sn\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.045235 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.045197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-openshift-service-ca\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.146366 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.146334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f62sn\" (UniqueName: \"kubernetes.io/projected/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-kube-api-access-f62sn\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.146494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.146378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-openshift-service-ca\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.146494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.146419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.146641 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:29:59.146528    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-serving-cert: secret "maas-api-e2e-migrate-3bb019f6-serving-cert" not found
Jul 27 21:29:59.146641 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:29:59.146594    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls podName:7ebecd6b-a878-4091-bb0d-b5d2e8ba5909 nodeName:}" failed. No retries permitted until 2026-07-27 21:29:59.646576054 +0000 UTC m=+1945.806966394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls") pod "maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85" (UID: "7ebecd6b-a878-4091-bb0d-b5d2e8ba5909") : secret "maas-api-e2e-migrate-3bb019f6-serving-cert" not found
Jul 27 21:29:59.147015 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.146997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-openshift-service-ca\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.161418 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.161390    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f62sn\" (UniqueName: \"kubernetes.io/projected/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-kube-api-access-f62sn\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.300577 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.300544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:59.649289 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.649211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.651739 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.651718    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls\") pod \"maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.676250 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.676223    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:59.768725 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.768684    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:29:59.909142 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.909073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:29:59.935448 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.934985    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"]
Jul 27 21:29:59.939301 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.939271    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:29:59.941818 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.941783    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3bb019f6\""
Jul 27 21:29:59.942803 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.942782    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3bb019f6-dockercfg-96xgb\""
Jul 27 21:29:59.946150 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.946115    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"]
Jul 27 21:29:59.951611 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.951569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f6c5\" (UniqueName: \"kubernetes.io/projected/72120324-f46e-4b54-aa19-57d431d43885-kube-api-access-6f6c5\") pod \"payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") " pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:29:59.951733 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:29:59.951675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72120324-f46e-4b54-aa19-57d431d43885-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") " pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:00.052656 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.052613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f6c5\" (UniqueName: \"kubernetes.io/projected/72120324-f46e-4b54-aa19-57d431d43885-kube-api-access-6f6c5\") pod \"payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") " pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:00.052813 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.052707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72120324-f46e-4b54-aa19-57d431d43885-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") " pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:00.053688 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.053567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72120324-f46e-4b54-aa19-57d431d43885-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") " pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:00.054901 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.054878    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"]
Jul 27 21:30:00.056476 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:00.056453    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebecd6b_a878_4091_bb0d_b5d2e8ba5909.slice/crio-65d5773b121774966908cae81be988175b10a1dbd98b21d855144bf5fe00e06e WatchSource:0}: Error finding container 65d5773b121774966908cae81be988175b10a1dbd98b21d855144bf5fe00e06e: Status 404 returned error can't find the container with id 65d5773b121774966908cae81be988175b10a1dbd98b21d855144bf5fe00e06e
Jul 27 21:30:00.061239 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.061219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f6c5\" (UniqueName: \"kubernetes.io/projected/72120324-f46e-4b54-aa19-57d431d43885-kube-api-access-6f6c5\") pod \"payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") " pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:00.137485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.137460    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"]
Jul 27 21:30:00.141943 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.141919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"
Jul 27 21:30:00.142638 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.142619    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5"]
Jul 27 21:30:00.144207 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.144186    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:30:00.145781 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.145765    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5"
Jul 27 21:30:00.147892 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.147840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"]
Jul 27 21:30:00.155567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.155543    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5"]
Jul 27 21:30:00.157578 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.157559    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"
Jul 27 21:30:00.180610 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.180576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5"
Jul 27 21:30:00.254063 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.253987    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:00.315859 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.315688    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"]
Jul 27 21:30:00.321304 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:00.321273    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426f6de5_0cab_4d2c_b766_ae0526fb78d1.slice/crio-513b276e0384c95e8dd8e975c1380bb9cf591629d4e599cec8f86a72ff99b367 WatchSource:0}: Error finding container 513b276e0384c95e8dd8e975c1380bb9cf591629d4e599cec8f86a72ff99b367: Status 404 returned error can't find the container with id 513b276e0384c95e8dd8e975c1380bb9cf591629d4e599cec8f86a72ff99b367
Jul 27 21:30:00.345110 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.345084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5"]
Jul 27 21:30:00.346666 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:00.346636    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69989e67_aaec_4d59_9aca_f347fe1ff33e.slice/crio-e5a580e0af108ba56d0af9716e2ddecac49e88337b6809d7d12ef3b27f5ca103 WatchSource:0}: Error finding container e5a580e0af108ba56d0af9716e2ddecac49e88337b6809d7d12ef3b27f5ca103: Status 404 returned error can't find the container with id e5a580e0af108ba56d0af9716e2ddecac49e88337b6809d7d12ef3b27f5ca103
Jul 27 21:30:00.417004 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.416973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"]
Jul 27 21:30:00.418253 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:00.418222    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72120324_f46e_4b54_aa19_57d431d43885.slice/crio-f236f256abffaa7d3876adba07246d7cf502fa62bcaee8b0964d05bc38991e78 WatchSource:0}: Error finding container f236f256abffaa7d3876adba07246d7cf502fa62bcaee8b0964d05bc38991e78: Status 404 returned error can't find the container with id f236f256abffaa7d3876adba07246d7cf502fa62bcaee8b0964d05bc38991e78
Jul 27 21:30:00.973154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.971018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5" event={"ID":"69989e67-aaec-4d59-9aca-f347fe1ff33e","Type":"ContainerStarted","Data":"f8418d3041afd6aba0d4015f52aba9ffa4e0d0581244d42bc8b83ab68fa59778"}
Jul 27 21:30:00.973154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.971123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5" event={"ID":"69989e67-aaec-4d59-9aca-f347fe1ff33e","Type":"ContainerStarted","Data":"e5a580e0af108ba56d0af9716e2ddecac49e88337b6809d7d12ef3b27f5ca103"}
Jul 27 21:30:00.976895 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.976856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" event={"ID":"426f6de5-0cab-4d2c-b766-ae0526fb78d1","Type":"ContainerStarted","Data":"66c5aa44cac930987ade04c4ca8f03ce7727ae47bb8f07961fa56c5a5141b3eb"}
Jul 27 21:30:00.977038 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.976921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" event={"ID":"426f6de5-0cab-4d2c-b766-ae0526fb78d1","Type":"ContainerStarted","Data":"513b276e0384c95e8dd8e975c1380bb9cf591629d4e599cec8f86a72ff99b367"}
Jul 27 21:30:00.979815 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.979789    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85" event={"ID":"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909","Type":"ContainerStarted","Data":"65d5773b121774966908cae81be988175b10a1dbd98b21d855144bf5fe00e06e"}
Jul 27 21:30:00.981657 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.981632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl" event={"ID":"72120324-f46e-4b54-aa19-57d431d43885","Type":"ContainerStarted","Data":"11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113"}
Jul 27 21:30:00.981771 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.981679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl" event={"ID":"72120324-f46e-4b54-aa19-57d431d43885","Type":"ContainerStarted","Data":"f236f256abffaa7d3876adba07246d7cf502fa62bcaee8b0964d05bc38991e78"}
Jul 27 21:30:00.981771 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.981728    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:00.991516 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:00.991461    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5" podStartSLOduration=0.991445361 podStartE2EDuration="991.445361ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:00.988222339 +0000 UTC m=+1947.148612719" watchObservedRunningTime="2026-07-27 21:30:00.991445361 +0000 UTC m=+1947.151835718"
Jul 27 21:30:01.006735 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:01.006310    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" podStartSLOduration=1.00629343 podStartE2EDuration="1.00629343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:01.004239445 +0000 UTC m=+1947.164629819" watchObservedRunningTime="2026-07-27 21:30:01.00629343 +0000 UTC m=+1947.166683790"
Jul 27 21:30:01.025628 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:01.025564    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl" podStartSLOduration=2.025546185 podStartE2EDuration="2.025546185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:01.021736002 +0000 UTC m=+1947.182126361" watchObservedRunningTime="2026-07-27 21:30:01.025546185 +0000 UTC m=+1947.185936544"
Jul 27 21:30:01.989800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:01.989762    2579 generic.go:356] "Generic (PLEG): container finished" podID="69989e67-aaec-4d59-9aca-f347fe1ff33e" containerID="f8418d3041afd6aba0d4015f52aba9ffa4e0d0581244d42bc8b83ab68fa59778" exitCode=0
Jul 27 21:30:01.990230 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:01.989861    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5" event={"ID":"69989e67-aaec-4d59-9aca-f347fe1ff33e","Type":"ContainerDied","Data":"f8418d3041afd6aba0d4015f52aba9ffa4e0d0581244d42bc8b83ab68fa59778"}
Jul 27 21:30:01.991887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:01.991862    2579 generic.go:356] "Generic (PLEG): container finished" podID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerID="66c5aa44cac930987ade04c4ca8f03ce7727ae47bb8f07961fa56c5a5141b3eb" exitCode=7
Jul 27 21:30:01.992040 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:01.991951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" event={"ID":"426f6de5-0cab-4d2c-b766-ae0526fb78d1","Type":"ContainerDied","Data":"66c5aa44cac930987ade04c4ca8f03ce7727ae47bb8f07961fa56c5a5141b3eb"}
Jul 27 21:30:01.992128 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:01.992102    2579 scope.go:117] "RemoveContainer" containerID="66c5aa44cac930987ade04c4ca8f03ce7727ae47bb8f07961fa56c5a5141b3eb"
Jul 27 21:30:02.999272 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:02.999238    2579 generic.go:356] "Generic (PLEG): container finished" podID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerID="681ea3f3a9311a83054af48ad0dc3523e9faf56dbd9681b14cb68e349869d1e1" exitCode=7
Jul 27 21:30:02.999708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:02.999318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" event={"ID":"426f6de5-0cab-4d2c-b766-ae0526fb78d1","Type":"ContainerDied","Data":"681ea3f3a9311a83054af48ad0dc3523e9faf56dbd9681b14cb68e349869d1e1"}
Jul 27 21:30:02.999708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:02.999376    2579 scope.go:117] "RemoveContainer" containerID="66c5aa44cac930987ade04c4ca8f03ce7727ae47bb8f07961fa56c5a5141b3eb"
Jul 27 21:30:02.999708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:02.999530    2579 scope.go:117] "RemoveContainer" containerID="681ea3f3a9311a83054af48ad0dc3523e9faf56dbd9681b14cb68e349869d1e1"
Jul 27 21:30:02.999870 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:30:02.999797    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9_odh-ai-gateway-infra(426f6de5-0cab-4d2c-b766-ae0526fb78d1)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1"
Jul 27 21:30:03.001076 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:03.001052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85" event={"ID":"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909","Type":"ContainerStarted","Data":"2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777"}
Jul 27 21:30:03.037521 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:03.037463    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85" podStartSLOduration=2.871043268 podStartE2EDuration="5.037441203s" totalImagesPullingTime="2.166397935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:03.036557729 +0000 UTC m=+1949.196948087" watchObservedRunningTime="2026-07-27 21:30:03.037441203 +0000 UTC m=+1949.197831562"
Jul 27 21:30:03.141079 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:03.141057    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5"
Jul 27 21:30:04.008233 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:04.008207    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5"
Jul 27 21:30:04.008639 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:04.008241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753130-gdns5" event={"ID":"69989e67-aaec-4d59-9aca-f347fe1ff33e","Type":"ContainerDied","Data":"e5a580e0af108ba56d0af9716e2ddecac49e88337b6809d7d12ef3b27f5ca103"}
Jul 27 21:30:04.008639 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:04.008295    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5a580e0af108ba56d0af9716e2ddecac49e88337b6809d7d12ef3b27f5ca103"
Jul 27 21:30:04.010184 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:04.010166    2579 scope.go:117] "RemoveContainer" containerID="681ea3f3a9311a83054af48ad0dc3523e9faf56dbd9681b14cb68e349869d1e1"
Jul 27 21:30:04.010359 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:30:04.010341    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9_odh-ai-gateway-infra(426f6de5-0cab-4d2c-b766-ae0526fb78d1)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1"
Jul 27 21:30:04.010428 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:04.010412    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:30:08.747695 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:08.747658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:30:10.021713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:10.021688    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:30:11.994519 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:11.994493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:15.384358 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:15.384331    2579 scope.go:117] "RemoveContainer" containerID="681ea3f3a9311a83054af48ad0dc3523e9faf56dbd9681b14cb68e349869d1e1"
Jul 27 21:30:16.077688 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:16.077655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" event={"ID":"426f6de5-0cab-4d2c-b766-ae0526fb78d1","Type":"ContainerStarted","Data":"5575d14c3efc577d2efaed2da20fe485866509dea85a05989b9a6c3df9f9280a"}
Jul 27 21:30:17.084291 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:17.084260    2579 generic.go:356] "Generic (PLEG): container finished" podID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerID="5575d14c3efc577d2efaed2da20fe485866509dea85a05989b9a6c3df9f9280a" exitCode=0
Jul 27 21:30:17.084727 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:17.084333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" event={"ID":"426f6de5-0cab-4d2c-b766-ae0526fb78d1","Type":"ContainerDied","Data":"5575d14c3efc577d2efaed2da20fe485866509dea85a05989b9a6c3df9f9280a"}
Jul 27 21:30:17.084727 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:17.084391    2579 scope.go:117] "RemoveContainer" containerID="681ea3f3a9311a83054af48ad0dc3523e9faf56dbd9681b14cb68e349869d1e1"
Jul 27 21:30:17.108794 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:17.108773    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"]
Jul 27 21:30:18.221207 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:18.221183    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"
Jul 27 21:30:19.097636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:19.097591    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"
Jul 27 21:30:19.097636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:19.097627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9" event={"ID":"426f6de5-0cab-4d2c-b766-ae0526fb78d1","Type":"ContainerDied","Data":"513b276e0384c95e8dd8e975c1380bb9cf591629d4e599cec8f86a72ff99b367"}
Jul 27 21:30:19.097795 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:19.097671    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="513b276e0384c95e8dd8e975c1380bb9cf591629d4e599cec8f86a72ff99b367"
Jul 27 21:30:19.132324 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:19.132300    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"]
Jul 27 21:30:19.138687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:19.138664    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3bb019f6-29753130-km7v9"]
Jul 27 21:30:20.388855 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:20.388825    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" path="/var/lib/kubelet/pods/426f6de5-0cab-4d2c-b766-ae0526fb78d1/volumes"
Jul 27 21:30:23.911336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911308    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"]
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911672    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911683    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911698    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911704    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911710    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69989e67-aaec-4d59-9aca-f347fe1ff33e" containerName="cleanup"
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911715    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="69989e67-aaec-4d59-9aca-f347fe1ff33e" containerName="cleanup"
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911721    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.911760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911725    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.912030 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911795    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.912030 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911804    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:23.912030 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.911813    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="69989e67-aaec-4d59-9aca-f347fe1ff33e" containerName="cleanup"
Jul 27 21:30:23.917857 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.917839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"
Jul 27 21:30:23.920794 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.920771    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:30:23.926057 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:23.926032    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"]
Jul 27 21:30:24.036895 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:24.036863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5bf082-b09b-4646-9572-9cae9bfbc00f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp\" (UID: \"9c5bf082-b09b-4646-9572-9cae9bfbc00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"
Jul 27 21:30:24.137969 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:24.137942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5bf082-b09b-4646-9572-9cae9bfbc00f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp\" (UID: \"9c5bf082-b09b-4646-9572-9cae9bfbc00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"
Jul 27 21:30:24.138501 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:24.138482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5bf082-b09b-4646-9572-9cae9bfbc00f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp\" (UID: \"9c5bf082-b09b-4646-9572-9cae9bfbc00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"
Jul 27 21:30:24.229455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:24.229395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"
Jul 27 21:30:24.392558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:24.392533    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"]
Jul 27 21:30:24.394997 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:24.394972    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5bf082_b09b_4646_9572_9cae9bfbc00f.slice/crio-3ffb34819d89d86c60a006c384fb6f5c37a8eba94fe38545a54ed741e7aef263 WatchSource:0}: Error finding container 3ffb34819d89d86c60a006c384fb6f5c37a8eba94fe38545a54ed741e7aef263: Status 404 returned error can't find the container with id 3ffb34819d89d86c60a006c384fb6f5c37a8eba94fe38545a54ed741e7aef263
Jul 27 21:30:25.130691 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:25.130655    2579 generic.go:356] "Generic (PLEG): container finished" podID="9c5bf082-b09b-4646-9572-9cae9bfbc00f" containerID="2d0be95ba6cd76209c8fe862a6bb679f9383f4150b083857264ab9b6407c9e21" exitCode=0
Jul 27 21:30:25.130962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:25.130739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp" event={"ID":"9c5bf082-b09b-4646-9572-9cae9bfbc00f","Type":"ContainerDied","Data":"2d0be95ba6cd76209c8fe862a6bb679f9383f4150b083857264ab9b6407c9e21"}
Jul 27 21:30:25.130962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:25.130821    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp" event={"ID":"9c5bf082-b09b-4646-9572-9cae9bfbc00f","Type":"ContainerStarted","Data":"3ffb34819d89d86c60a006c384fb6f5c37a8eba94fe38545a54ed741e7aef263"}
Jul 27 21:30:26.265751 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:26.265728    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"
Jul 27 21:30:26.356750 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:26.356726    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5bf082-b09b-4646-9572-9cae9bfbc00f-maas-api-service-ca\") pod \"9c5bf082-b09b-4646-9572-9cae9bfbc00f\" (UID: \"9c5bf082-b09b-4646-9572-9cae9bfbc00f\") "
Jul 27 21:30:26.357090 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:26.357070    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c5bf082-b09b-4646-9572-9cae9bfbc00f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c5bf082-b09b-4646-9572-9cae9bfbc00f" (UID: "9c5bf082-b09b-4646-9572-9cae9bfbc00f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:26.457703 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:26.457654    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5bf082-b09b-4646-9572-9cae9bfbc00f-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:30:27.142520 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:27.142497    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"
Jul 27 21:30:27.142661 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:27.142523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp" event={"ID":"9c5bf082-b09b-4646-9572-9cae9bfbc00f","Type":"ContainerDied","Data":"3ffb34819d89d86c60a006c384fb6f5c37a8eba94fe38545a54ed741e7aef263"}
Jul 27 21:30:27.142661 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:27.142568    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ffb34819d89d86c60a006c384fb6f5c37a8eba94fe38545a54ed741e7aef263"
Jul 27 21:30:32.368148 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:32.368110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:34.501255 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.501228    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"]
Jul 27 21:30:34.501636 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.501449    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85" podUID="7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" containerName="maas-api" containerID="cri-o://2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777" gracePeriod=30
Jul 27 21:30:34.534046 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.534016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:34.558427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.557923    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"]
Jul 27 21:30:34.558427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.558220    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl" podUID="72120324-f46e-4b54-aa19-57d431d43885" containerName="payload-processing" containerID="cri-o://11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113" gracePeriod=30
Jul 27 21:30:34.635824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.635796    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:34.710433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.710394    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"]
Jul 27 21:30:34.713686 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.713584    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3bb019f6-hl4pp"]
Jul 27 21:30:34.716311 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.716276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:34.832567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.832545    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:30:34.849328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.849293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:34.901398 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.901366    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:34.925384 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925363    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f62sn\" (UniqueName: \"kubernetes.io/projected/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-kube-api-access-f62sn\") pod \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") "
Jul 27 21:30:34.925491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f6c5\" (UniqueName: \"kubernetes.io/projected/72120324-f46e-4b54-aa19-57d431d43885-kube-api-access-6f6c5\") pod \"72120324-f46e-4b54-aa19-57d431d43885\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") "
Jul 27 21:30:34.925491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-openshift-service-ca\") pod \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") "
Jul 27 21:30:34.925491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72120324-f46e-4b54-aa19-57d431d43885-plugins-config-volume\") pod \"72120324-f46e-4b54-aa19-57d431d43885\" (UID: \"72120324-f46e-4b54-aa19-57d431d43885\") "
Jul 27 21:30:34.925684 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925496    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls\") pod \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\" (UID: \"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909\") "
Jul 27 21:30:34.925824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925805    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" (UID: "7ebecd6b-a878-4091-bb0d-b5d2e8ba5909"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:34.925891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925871    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72120324-f46e-4b54-aa19-57d431d43885-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72120324-f46e-4b54-aa19-57d431d43885" (UID: "72120324-f46e-4b54-aa19-57d431d43885"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:34.925948 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.925895    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:30:34.927664 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.927638    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72120324-f46e-4b54-aa19-57d431d43885-kube-api-access-6f6c5" (OuterVolumeSpecName: "kube-api-access-6f6c5") pod "72120324-f46e-4b54-aa19-57d431d43885" (UID: "72120324-f46e-4b54-aa19-57d431d43885"). InnerVolumeSpecName "kube-api-access-6f6c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:34.927848 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.927833    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-kube-api-access-f62sn" (OuterVolumeSpecName: "kube-api-access-f62sn") pod "7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" (UID: "7ebecd6b-a878-4091-bb0d-b5d2e8ba5909"). InnerVolumeSpecName "kube-api-access-f62sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:34.927925 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:34.927907    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" (UID: "7ebecd6b-a878-4091-bb0d-b5d2e8ba5909"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:30:35.027208 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.027138    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f62sn\" (UniqueName: \"kubernetes.io/projected/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-kube-api-access-f62sn\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:30:35.027208 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.027164    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f6c5\" (UniqueName: \"kubernetes.io/projected/72120324-f46e-4b54-aa19-57d431d43885-kube-api-access-6f6c5\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:30:35.027208 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.027173    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72120324-f46e-4b54-aa19-57d431d43885-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:30:35.027208 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.027182    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:30:35.140795 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.140760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:35.185123 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.185097    2579 generic.go:356] "Generic (PLEG): container finished" podID="7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" containerID="2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777" exitCode=0
Jul 27 21:30:35.185205 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.185142    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"
Jul 27 21:30:35.185205 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.185184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85" event={"ID":"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909","Type":"ContainerDied","Data":"2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777"}
Jul 27 21:30:35.185297 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.185262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85" event={"ID":"7ebecd6b-a878-4091-bb0d-b5d2e8ba5909","Type":"ContainerDied","Data":"65d5773b121774966908cae81be988175b10a1dbd98b21d855144bf5fe00e06e"}
Jul 27 21:30:35.185346 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.185296    2579 scope.go:117] "RemoveContainer" containerID="2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777"
Jul 27 21:30:35.186540 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.186519    2579 generic.go:356] "Generic (PLEG): container finished" podID="72120324-f46e-4b54-aa19-57d431d43885" containerID="11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113" exitCode=0
Jul 27 21:30:35.186662 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.186554    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"
Jul 27 21:30:35.186662 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.186629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl" event={"ID":"72120324-f46e-4b54-aa19-57d431d43885","Type":"ContainerDied","Data":"11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113"}
Jul 27 21:30:35.186770 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.186680    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl" event={"ID":"72120324-f46e-4b54-aa19-57d431d43885","Type":"ContainerDied","Data":"f236f256abffaa7d3876adba07246d7cf502fa62bcaee8b0964d05bc38991e78"}
Jul 27 21:30:35.193976 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.193962    2579 scope.go:117] "RemoveContainer" containerID="2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777"
Jul 27 21:30:35.194252 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:30:35.194221    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777\": container with ID starting with 2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777 not found: ID does not exist" containerID="2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777"
Jul 27 21:30:35.194358 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.194256    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777"} err="failed to get container status \"2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777\": rpc error: code = NotFound desc = could not find container \"2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777\": container with ID starting with 2c56a5689ff779183b38e5fcb287ffdd446588d6184f2179507803292e5d3777 not found: ID does not exist"
Jul 27 21:30:35.194358 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.194273    2579 scope.go:117] "RemoveContainer" containerID="11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113"
Jul 27 21:30:35.202526 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.202510    2579 scope.go:117] "RemoveContainer" containerID="11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113"
Jul 27 21:30:35.202820 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:30:35.202803    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113\": container with ID starting with 11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113 not found: ID does not exist" containerID="11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113"
Jul 27 21:30:35.202881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.202826    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113"} err="failed to get container status \"11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113\": rpc error: code = NotFound desc = could not find container \"11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113\": container with ID starting with 11407bd5533dc6135e2430050a72d96f6c5444019e2b281ab726f846d2e7f113 not found: ID does not exist"
Jul 27 21:30:35.217100 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.217077    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"]
Jul 27 21:30:35.221981 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.221951    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3bb019f6-589d674b4d-llv85"]
Jul 27 21:30:35.232478 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.232454    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"]
Jul 27 21:30:35.236968 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.236949    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3bb019f6-6d65f8ddf-2sxfl"]
Jul 27 21:30:35.396210 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.396138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:35.736176 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:35.736094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:36.013666 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:36.013570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:36.389421 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:36.389390    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72120324-f46e-4b54-aa19-57d431d43885" path="/var/lib/kubelet/pods/72120324-f46e-4b54-aa19-57d431d43885/volumes"
Jul 27 21:30:36.389815 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:36.389799    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" path="/var/lib/kubelet/pods/7ebecd6b-a878-4091-bb0d-b5d2e8ba5909/volumes"
Jul 27 21:30:36.390075 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:36.390064    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c5bf082-b09b-4646-9572-9cae9bfbc00f" path="/var/lib/kubelet/pods/9c5bf082-b09b-4646-9572-9cae9bfbc00f/volumes"
Jul 27 21:30:37.914551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.914512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:37.986816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.986784    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"]
Jul 27 21:30:37.987123 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987111    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" containerName="maas-api"
Jul 27 21:30:37.987182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987125    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" containerName="maas-api"
Jul 27 21:30:37.987182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987152    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72120324-f46e-4b54-aa19-57d431d43885" containerName="payload-processing"
Jul 27 21:30:37.987182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987157    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="72120324-f46e-4b54-aa19-57d431d43885" containerName="payload-processing"
Jul 27 21:30:37.987182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987165    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5bf082-b09b-4646-9572-9cae9bfbc00f" containerName="revoke-keys"
Jul 27 21:30:37.987182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987170    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5bf082-b09b-4646-9572-9cae9bfbc00f" containerName="revoke-keys"
Jul 27 21:30:37.987336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987226    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebecd6b-a878-4091-bb0d-b5d2e8ba5909" containerName="maas-api"
Jul 27 21:30:37.987336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987234    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5bf082-b09b-4646-9572-9cae9bfbc00f" containerName="revoke-keys"
Jul 27 21:30:37.987336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987240    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="426f6de5-0cab-4d2c-b766-ae0526fb78d1" containerName="cleanup"
Jul 27 21:30:37.987336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.987247    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="72120324-f46e-4b54-aa19-57d431d43885" containerName="payload-processing"
Jul 27 21:30:37.989887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.989872    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:37.992438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.992417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gdtk\""
Jul 27 21:30:37.992562 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.992448    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 21:30:37.993280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.993261    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:30:37.993280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:37.993264    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0d4e25e7-serving-cert\""
Jul 27 21:30:38.001698 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.001673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"]
Jul 27 21:30:38.018426 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.018402    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:38.049065 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.049035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd33163-11d5-4d48-b946-2df06e345ce4-openshift-service-ca\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.049167 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.049122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd33163-11d5-4d48-b946-2df06e345ce4-maas-api-tls\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.049167 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.049150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6kd7\" (UniqueName: \"kubernetes.io/projected/ffd33163-11d5-4d48-b946-2df06e345ce4-kube-api-access-g6kd7\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.116932 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.116905    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:38.149976 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.149951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd33163-11d5-4d48-b946-2df06e345ce4-maas-api-tls\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.150084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.149991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6kd7\" (UniqueName: \"kubernetes.io/projected/ffd33163-11d5-4d48-b946-2df06e345ce4-kube-api-access-g6kd7\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.150084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.150022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd33163-11d5-4d48-b946-2df06e345ce4-openshift-service-ca\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.150701 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.150684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd33163-11d5-4d48-b946-2df06e345ce4-openshift-service-ca\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.152655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.152637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd33163-11d5-4d48-b946-2df06e345ce4-maas-api-tls\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.158939 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.158907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6kd7\" (UniqueName: \"kubernetes.io/projected/ffd33163-11d5-4d48-b946-2df06e345ce4-kube-api-access-g6kd7\") pod \"maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.218787 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.218718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:38.300546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.300519    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:38.440961 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:38.440908    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd33163_11d5_4d48_b946_2df06e345ce4.slice/crio-fdbcf97aa642cb3a9125032d3f88d59dc085527d28127da7d1ca1272ed05e1e2 WatchSource:0}: Error finding container fdbcf97aa642cb3a9125032d3f88d59dc085527d28127da7d1ca1272ed05e1e2: Status 404 returned error can't find the container with id fdbcf97aa642cb3a9125032d3f88d59dc085527d28127da7d1ca1272ed05e1e2
Jul 27 21:30:38.444961 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.444893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"]
Jul 27 21:30:38.466419 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.466397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:30:38.616315 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.616287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:38.716213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.716184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:30:38.745711 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.745691    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"]
Jul 27 21:30:38.750020 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.750004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:38.753565 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.753543    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0d4e25e7\""
Jul 27 21:30:38.753707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.753690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0d4e25e7-dockercfg-lvmwp\""
Jul 27 21:30:38.761404 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.761380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"]
Jul 27 21:30:38.800704 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.800680    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"]
Jul 27 21:30:38.803793 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.803779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:38.812877 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.812854    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"]
Jul 27 21:30:38.856164 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.856142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8490f-a66a-4b15-b972-df92b1f97395-plugins-config-volume\") pod \"payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") " pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:38.856255 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.856195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjwxj\" (UniqueName: \"kubernetes.io/projected/4ca8490f-a66a-4b15-b972-df92b1f97395-kube-api-access-gjwxj\") pod \"payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") " pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:38.957470 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.957440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66b199b5-8a72-4252-9962-7a46f529ff80-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:38.957838 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.957502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8490f-a66a-4b15-b972-df92b1f97395-plugins-config-volume\") pod \"payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") " pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:38.957838 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.957574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff45s\" (UniqueName: \"kubernetes.io/projected/66b199b5-8a72-4252-9962-7a46f529ff80-kube-api-access-ff45s\") pod \"payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:38.957838 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.957655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjwxj\" (UniqueName: \"kubernetes.io/projected/4ca8490f-a66a-4b15-b972-df92b1f97395-kube-api-access-gjwxj\") pod \"payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") " pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:38.958071 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.958055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8490f-a66a-4b15-b972-df92b1f97395-plugins-config-volume\") pod \"payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") " pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:38.969035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:38.969010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjwxj\" (UniqueName: \"kubernetes.io/projected/4ca8490f-a66a-4b15-b972-df92b1f97395-kube-api-access-gjwxj\") pod \"payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") " pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:39.058745 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.058719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66b199b5-8a72-4252-9962-7a46f529ff80-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:39.058862 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.058830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff45s\" (UniqueName: \"kubernetes.io/projected/66b199b5-8a72-4252-9962-7a46f529ff80-kube-api-access-ff45s\") pod \"payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:39.059328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.059312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66b199b5-8a72-4252-9962-7a46f529ff80-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:39.061687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.061668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:39.070274 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.070253    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff45s\" (UniqueName: \"kubernetes.io/projected/66b199b5-8a72-4252-9962-7a46f529ff80-kube-api-access-ff45s\") pod \"payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:39.115317 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.115290    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:39.203995 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.203969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"]
Jul 27 21:30:39.204906 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:39.204875    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca8490f_a66a_4b15_b972_df92b1f97395.slice/crio-830f51d996fe47278f18fb8f81227a406b77fe7a9814f2e1343df51099b7c9d5 WatchSource:0}: Error finding container 830f51d996fe47278f18fb8f81227a406b77fe7a9814f2e1343df51099b7c9d5: Status 404 returned error can't find the container with id 830f51d996fe47278f18fb8f81227a406b77fe7a9814f2e1343df51099b7c9d5
Jul 27 21:30:39.214684 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.214634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972" event={"ID":"ffd33163-11d5-4d48-b946-2df06e345ce4","Type":"ContainerStarted","Data":"4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e"}
Jul 27 21:30:39.214800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.214703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972" event={"ID":"ffd33163-11d5-4d48-b946-2df06e345ce4","Type":"ContainerStarted","Data":"fdbcf97aa642cb3a9125032d3f88d59dc085527d28127da7d1ca1272ed05e1e2"}
Jul 27 21:30:39.214911 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.214891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:39.235109 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.235061    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972" podStartSLOduration=1.823423049 podStartE2EDuration="2.235040571s" totalImagesPullingTime="411.617522ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:39.234313604 +0000 UTC m=+1985.394703985" watchObservedRunningTime="2026-07-27 21:30:39.235040571 +0000 UTC m=+1985.395430930"
Jul 27 21:30:39.271123 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:39.271102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"]
Jul 27 21:30:39.273076 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:30:39.273049    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b199b5_8a72_4252_9962_7a46f529ff80.slice/crio-f592d22b26ba3033633cf32e99044fe16de541a2e697f472e7fb736a8920350a WatchSource:0}: Error finding container f592d22b26ba3033633cf32e99044fe16de541a2e697f472e7fb736a8920350a: Status 404 returned error can't find the container with id f592d22b26ba3033633cf32e99044fe16de541a2e697f472e7fb736a8920350a
Jul 27 21:30:40.225375 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.225338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs" event={"ID":"4ca8490f-a66a-4b15-b972-df92b1f97395","Type":"ContainerStarted","Data":"f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7"}
Jul 27 21:30:40.225852 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.225434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs" event={"ID":"4ca8490f-a66a-4b15-b972-df92b1f97395","Type":"ContainerStarted","Data":"830f51d996fe47278f18fb8f81227a406b77fe7a9814f2e1343df51099b7c9d5"}
Jul 27 21:30:40.225852 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.225462    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:40.227185 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.227159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n" event={"ID":"66b199b5-8a72-4252-9962-7a46f529ff80","Type":"ContainerStarted","Data":"3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b"}
Jul 27 21:30:40.227310 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.227208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n" event={"ID":"66b199b5-8a72-4252-9962-7a46f529ff80","Type":"ContainerStarted","Data":"f592d22b26ba3033633cf32e99044fe16de541a2e697f472e7fb736a8920350a"}
Jul 27 21:30:40.227370 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.227318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:30:40.243578 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.243540    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs" podStartSLOduration=2.243526769 podStartE2EDuration="2.243526769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:40.242245301 +0000 UTC m=+1986.402635659" watchObservedRunningTime="2026-07-27 21:30:40.243526769 +0000 UTC m=+1986.403917126"
Jul 27 21:30:40.265427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:40.265385    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n" podStartSLOduration=2.265369519 podStartE2EDuration="2.265369519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:40.263304695 +0000 UTC m=+1986.423695066" watchObservedRunningTime="2026-07-27 21:30:40.265369519 +0000 UTC m=+1986.425759878"
Jul 27 21:30:45.232856 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:45.232826    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:30:48.552813 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:48.552779    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:30:51.240278 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:51.240252    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:30:51.240730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:30:51.240318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:31:03.920778 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:03.920739    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"]
Jul 27 21:31:03.925581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:03.925562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"
Jul 27 21:31:03.928238 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:03.928213    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:31:03.932075 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:03.932051    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"]
Jul 27 21:31:04.061169 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:04.061119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63609fa2-83f8-4002-a15b-f63a7657919c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt\" (UID: \"63609fa2-83f8-4002-a15b-f63a7657919c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"
Jul 27 21:31:04.161688 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:04.161648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63609fa2-83f8-4002-a15b-f63a7657919c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt\" (UID: \"63609fa2-83f8-4002-a15b-f63a7657919c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"
Jul 27 21:31:04.162340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:04.162312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63609fa2-83f8-4002-a15b-f63a7657919c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt\" (UID: \"63609fa2-83f8-4002-a15b-f63a7657919c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"
Jul 27 21:31:04.239004 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:04.238910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"
Jul 27 21:31:04.373775 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:04.373734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"]
Jul 27 21:31:04.375033 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:31:04.375009    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63609fa2_83f8_4002_a15b_f63a7657919c.slice/crio-ec7bbca5e1ad45db99bda769dcc5abecab760344ab92a994134e16a3554c97f1 WatchSource:0}: Error finding container ec7bbca5e1ad45db99bda769dcc5abecab760344ab92a994134e16a3554c97f1: Status 404 returned error can't find the container with id ec7bbca5e1ad45db99bda769dcc5abecab760344ab92a994134e16a3554c97f1
Jul 27 21:31:05.375692 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:05.375660    2579 generic.go:356] "Generic (PLEG): container finished" podID="63609fa2-83f8-4002-a15b-f63a7657919c" containerID="6de5ca1d6510b1ce6667af308303f6a1886944062bab7e5c46d1265f1a1d57f8" exitCode=0
Jul 27 21:31:05.376095 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:05.375745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt" event={"ID":"63609fa2-83f8-4002-a15b-f63a7657919c","Type":"ContainerDied","Data":"6de5ca1d6510b1ce6667af308303f6a1886944062bab7e5c46d1265f1a1d57f8"}
Jul 27 21:31:05.376095 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:05.375794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt" event={"ID":"63609fa2-83f8-4002-a15b-f63a7657919c","Type":"ContainerStarted","Data":"ec7bbca5e1ad45db99bda769dcc5abecab760344ab92a994134e16a3554c97f1"}
Jul 27 21:31:06.517661 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:06.517636    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"
Jul 27 21:31:06.582316 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:06.582289    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63609fa2-83f8-4002-a15b-f63a7657919c-maas-api-service-ca\") pod \"63609fa2-83f8-4002-a15b-f63a7657919c\" (UID: \"63609fa2-83f8-4002-a15b-f63a7657919c\") "
Jul 27 21:31:06.582670 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:06.582647    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63609fa2-83f8-4002-a15b-f63a7657919c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63609fa2-83f8-4002-a15b-f63a7657919c" (UID: "63609fa2-83f8-4002-a15b-f63a7657919c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:06.683135 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:06.683062    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63609fa2-83f8-4002-a15b-f63a7657919c-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:07.388815 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:07.388785    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"
Jul 27 21:31:07.388967 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:07.388823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt" event={"ID":"63609fa2-83f8-4002-a15b-f63a7657919c","Type":"ContainerDied","Data":"ec7bbca5e1ad45db99bda769dcc5abecab760344ab92a994134e16a3554c97f1"}
Jul 27 21:31:07.388967 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:07.388868    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec7bbca5e1ad45db99bda769dcc5abecab760344ab92a994134e16a3554c97f1"
Jul 27 21:31:14.392115 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.392086    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"]
Jul 27 21:31:14.392532 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.392265    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972" podUID="ffd33163-11d5-4d48-b946-2df06e345ce4" containerName="maas-api" containerID="cri-o://4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e" gracePeriod=30
Jul 27 21:31:14.456035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.456002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:14.457022 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.456990    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"]
Jul 27 21:31:14.457215 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.457192    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs" podUID="4ca8490f-a66a-4b15-b972-df92b1f97395" containerName="payload-processing" containerID="cri-o://f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7" gracePeriod=30
Jul 27 21:31:14.462447 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.462183    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"]
Jul 27 21:31:14.462447 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.462397    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n" podUID="66b199b5-8a72-4252-9962-7a46f529ff80" containerName="payload-pre-processing" containerID="cri-o://3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b" gracePeriod=30
Jul 27 21:31:14.529708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.529669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:14.672172 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.672107    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"]
Jul 27 21:31:14.682188 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.681787    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:14.687912 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.686671    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d4e25e7-pnbdt"]
Jul 27 21:31:14.745975 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.745950    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:31:14.750853 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.750832    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:31:14.761018 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.760999    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:31:14.848363 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848333    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd33163-11d5-4d48-b946-2df06e345ce4-maas-api-tls\") pod \"ffd33163-11d5-4d48-b946-2df06e345ce4\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") "
Jul 27 21:31:14.848530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848378    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjwxj\" (UniqueName: \"kubernetes.io/projected/4ca8490f-a66a-4b15-b972-df92b1f97395-kube-api-access-gjwxj\") pod \"4ca8490f-a66a-4b15-b972-df92b1f97395\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") "
Jul 27 21:31:14.848530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848416    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd33163-11d5-4d48-b946-2df06e345ce4-openshift-service-ca\") pod \"ffd33163-11d5-4d48-b946-2df06e345ce4\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") "
Jul 27 21:31:14.848530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848460    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6kd7\" (UniqueName: \"kubernetes.io/projected/ffd33163-11d5-4d48-b946-2df06e345ce4-kube-api-access-g6kd7\") pod \"ffd33163-11d5-4d48-b946-2df06e345ce4\" (UID: \"ffd33163-11d5-4d48-b946-2df06e345ce4\") "
Jul 27 21:31:14.848530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848510    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8490f-a66a-4b15-b972-df92b1f97395-plugins-config-volume\") pod \"4ca8490f-a66a-4b15-b972-df92b1f97395\" (UID: \"4ca8490f-a66a-4b15-b972-df92b1f97395\") "
Jul 27 21:31:14.848820 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848548    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff45s\" (UniqueName: \"kubernetes.io/projected/66b199b5-8a72-4252-9962-7a46f529ff80-kube-api-access-ff45s\") pod \"66b199b5-8a72-4252-9962-7a46f529ff80\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") "
Jul 27 21:31:14.848820 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848583    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66b199b5-8a72-4252-9962-7a46f529ff80-plugins-config-volume\") pod \"66b199b5-8a72-4252-9962-7a46f529ff80\" (UID: \"66b199b5-8a72-4252-9962-7a46f529ff80\") "
Jul 27 21:31:14.848901 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.848880    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd33163-11d5-4d48-b946-2df06e345ce4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffd33163-11d5-4d48-b946-2df06e345ce4" (UID: "ffd33163-11d5-4d48-b946-2df06e345ce4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:14.849280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.849195    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66b199b5-8a72-4252-9962-7a46f529ff80-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "66b199b5-8a72-4252-9962-7a46f529ff80" (UID: "66b199b5-8a72-4252-9962-7a46f529ff80"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:14.849280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.849217    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca8490f-a66a-4b15-b972-df92b1f97395-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ca8490f-a66a-4b15-b972-df92b1f97395" (UID: "4ca8490f-a66a-4b15-b972-df92b1f97395"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:14.851186 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.851162    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ca8490f-a66a-4b15-b972-df92b1f97395-kube-api-access-gjwxj" (OuterVolumeSpecName: "kube-api-access-gjwxj") pod "4ca8490f-a66a-4b15-b972-df92b1f97395" (UID: "4ca8490f-a66a-4b15-b972-df92b1f97395"). InnerVolumeSpecName "kube-api-access-gjwxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:14.851186 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.851169    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66b199b5-8a72-4252-9962-7a46f529ff80-kube-api-access-ff45s" (OuterVolumeSpecName: "kube-api-access-ff45s") pod "66b199b5-8a72-4252-9962-7a46f529ff80" (UID: "66b199b5-8a72-4252-9962-7a46f529ff80"). InnerVolumeSpecName "kube-api-access-ff45s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:14.851357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.851217    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffd33163-11d5-4d48-b946-2df06e345ce4-kube-api-access-g6kd7" (OuterVolumeSpecName: "kube-api-access-g6kd7") pod "ffd33163-11d5-4d48-b946-2df06e345ce4" (UID: "ffd33163-11d5-4d48-b946-2df06e345ce4"). InnerVolumeSpecName "kube-api-access-g6kd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:14.851357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.851232    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffd33163-11d5-4d48-b946-2df06e345ce4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffd33163-11d5-4d48-b946-2df06e345ce4" (UID: "ffd33163-11d5-4d48-b946-2df06e345ce4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:31:14.950025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.949938    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd33163-11d5-4d48-b946-2df06e345ce4-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:14.950025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.949966    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjwxj\" (UniqueName: \"kubernetes.io/projected/4ca8490f-a66a-4b15-b972-df92b1f97395-kube-api-access-gjwxj\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:14.950025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.949978    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd33163-11d5-4d48-b946-2df06e345ce4-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:14.950025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.949987    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6kd7\" (UniqueName: \"kubernetes.io/projected/ffd33163-11d5-4d48-b946-2df06e345ce4-kube-api-access-g6kd7\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:14.950025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.949998    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8490f-a66a-4b15-b972-df92b1f97395-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:14.950025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.950006    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff45s\" (UniqueName: \"kubernetes.io/projected/66b199b5-8a72-4252-9962-7a46f529ff80-kube-api-access-ff45s\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:14.950025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:14.950015    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66b199b5-8a72-4252-9962-7a46f529ff80-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:15.436044 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.436008    2579 generic.go:356] "Generic (PLEG): container finished" podID="4ca8490f-a66a-4b15-b972-df92b1f97395" containerID="f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7" exitCode=0
Jul 27 21:31:15.436428 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.436060    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"
Jul 27 21:31:15.436428 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.436101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs" event={"ID":"4ca8490f-a66a-4b15-b972-df92b1f97395","Type":"ContainerDied","Data":"f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7"}
Jul 27 21:31:15.436428 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.436156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs" event={"ID":"4ca8490f-a66a-4b15-b972-df92b1f97395","Type":"ContainerDied","Data":"830f51d996fe47278f18fb8f81227a406b77fe7a9814f2e1343df51099b7c9d5"}
Jul 27 21:31:15.436428 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.436186    2579 scope.go:117] "RemoveContainer" containerID="f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7"
Jul 27 21:31:15.437488 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.437414    2579 generic.go:356] "Generic (PLEG): container finished" podID="ffd33163-11d5-4d48-b946-2df06e345ce4" containerID="4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e" exitCode=0
Jul 27 21:31:15.437488 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.437461    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"
Jul 27 21:31:15.437650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.437497    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972" event={"ID":"ffd33163-11d5-4d48-b946-2df06e345ce4","Type":"ContainerDied","Data":"4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e"}
Jul 27 21:31:15.437650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.437545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972" event={"ID":"ffd33163-11d5-4d48-b946-2df06e345ce4","Type":"ContainerDied","Data":"fdbcf97aa642cb3a9125032d3f88d59dc085527d28127da7d1ca1272ed05e1e2"}
Jul 27 21:31:15.438947 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.438921    2579 generic.go:356] "Generic (PLEG): container finished" podID="66b199b5-8a72-4252-9962-7a46f529ff80" containerID="3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b" exitCode=0
Jul 27 21:31:15.439139 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.438969    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"
Jul 27 21:31:15.439139 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.439007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n" event={"ID":"66b199b5-8a72-4252-9962-7a46f529ff80","Type":"ContainerDied","Data":"3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b"}
Jul 27 21:31:15.439139 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.439054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n" event={"ID":"66b199b5-8a72-4252-9962-7a46f529ff80","Type":"ContainerDied","Data":"f592d22b26ba3033633cf32e99044fe16de541a2e697f472e7fb736a8920350a"}
Jul 27 21:31:15.447232 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.447212    2579 scope.go:117] "RemoveContainer" containerID="f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7"
Jul 27 21:31:15.447485 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:31:15.447467    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7\": container with ID starting with f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7 not found: ID does not exist" containerID="f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7"
Jul 27 21:31:15.447551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.447493    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7"} err="failed to get container status \"f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7\": rpc error: code = NotFound desc = could not find container \"f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7\": container with ID starting with f4e944ea60d66551ad4dc83d58ccad828072a216f0113a599c61fe10b0cb23f7 not found: ID does not exist"
Jul 27 21:31:15.447551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.447511    2579 scope.go:117] "RemoveContainer" containerID="4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e"
Jul 27 21:31:15.456092 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.456074    2579 scope.go:117] "RemoveContainer" containerID="4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e"
Jul 27 21:31:15.456343 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:31:15.456325    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e\": container with ID starting with 4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e not found: ID does not exist" containerID="4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e"
Jul 27 21:31:15.456397 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.456351    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e"} err="failed to get container status \"4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e\": rpc error: code = NotFound desc = could not find container \"4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e\": container with ID starting with 4ce55d53cb611ea718a9caa2a3968f70a3a5711ef75dc79b1b66ca9349e82b5e not found: ID does not exist"
Jul 27 21:31:15.456397 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.456367    2579 scope.go:117] "RemoveContainer" containerID="3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b"
Jul 27 21:31:15.461251 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.461230    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"]
Jul 27 21:31:15.465227 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.465211    2579 scope.go:117] "RemoveContainer" containerID="3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b"
Jul 27 21:31:15.465450 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:31:15.465431    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b\": container with ID starting with 3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b not found: ID does not exist" containerID="3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b"
Jul 27 21:31:15.465500 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.465456    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b"} err="failed to get container status \"3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b\": rpc error: code = NotFound desc = could not find container \"3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b\": container with ID starting with 3adb21c04a54f4d3408987a92e501985c31f0180894d211901a9a4b07b4f3d7b not found: ID does not exist"
Jul 27 21:31:15.469780 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.469748    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0d4e25e7-7fcc7f5464-fpzjs"]
Jul 27 21:31:15.480888 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.480868    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"]
Jul 27 21:31:15.484737 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.484717    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0d4e25e7-596494f644-9m96n"]
Jul 27 21:31:15.497468 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.497450    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"]
Jul 27 21:31:15.502956 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:15.502938    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d4e25e7-85b8cbb56-g5972"]
Jul 27 21:31:16.005692 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.005659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:16.233990 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.233941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:16.390867 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.390826    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ca8490f-a66a-4b15-b972-df92b1f97395" path="/var/lib/kubelet/pods/4ca8490f-a66a-4b15-b972-df92b1f97395/volumes"
Jul 27 21:31:16.391267 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.391247    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63609fa2-83f8-4002-a15b-f63a7657919c" path="/var/lib/kubelet/pods/63609fa2-83f8-4002-a15b-f63a7657919c/volumes"
Jul 27 21:31:16.391652 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.391634    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66b199b5-8a72-4252-9962-7a46f529ff80" path="/var/lib/kubelet/pods/66b199b5-8a72-4252-9962-7a46f529ff80/volumes"
Jul 27 21:31:16.392034 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.392015    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffd33163-11d5-4d48-b946-2df06e345ce4" path="/var/lib/kubelet/pods/ffd33163-11d5-4d48-b946-2df06e345ce4/volumes"
Jul 27 21:31:16.501676 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.501634    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:16.854177 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:16.854133    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:17.250232 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:17.250132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:18.346414 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:18.346381    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:31:19.118414 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.118381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:19.206986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.206940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:19.212217 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212187    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"]
Jul 27 21:31:19.212579 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212564    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b199b5-8a72-4252-9962-7a46f529ff80" containerName="payload-pre-processing"
Jul 27 21:31:19.212579 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212578    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b199b5-8a72-4252-9962-7a46f529ff80" containerName="payload-pre-processing"
Jul 27 21:31:19.212765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212590    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ca8490f-a66a-4b15-b972-df92b1f97395" containerName="payload-processing"
Jul 27 21:31:19.212765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212615    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ca8490f-a66a-4b15-b972-df92b1f97395" containerName="payload-processing"
Jul 27 21:31:19.212765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212625    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63609fa2-83f8-4002-a15b-f63a7657919c" containerName="revoke-keys"
Jul 27 21:31:19.212765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212647    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="63609fa2-83f8-4002-a15b-f63a7657919c" containerName="revoke-keys"
Jul 27 21:31:19.212765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212673    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd33163-11d5-4d48-b946-2df06e345ce4" containerName="maas-api"
Jul 27 21:31:19.212765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212681    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd33163-11d5-4d48-b946-2df06e345ce4" containerName="maas-api"
Jul 27 21:31:19.212765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212766    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ca8490f-a66a-4b15-b972-df92b1f97395" containerName="payload-processing"
Jul 27 21:31:19.213011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212779    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="66b199b5-8a72-4252-9962-7a46f529ff80" containerName="payload-pre-processing"
Jul 27 21:31:19.213011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212786    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="63609fa2-83f8-4002-a15b-f63a7657919c" containerName="revoke-keys"
Jul 27 21:31:19.213011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.212795    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffd33163-11d5-4d48-b946-2df06e345ce4" containerName="maas-api"
Jul 27 21:31:19.217823 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.217797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.220252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.220227    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gdtk\""
Jul 27 21:31:19.220252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.220227    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:31:19.220409 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.220229    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 21:31:19.220409 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.220229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-51e5669d-serving-cert\""
Jul 27 21:31:19.228446 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.228415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"]
Jul 27 21:31:19.274860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.274827    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:19.285892 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.285869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-maas-api-tls\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.286027 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.285923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-openshift-service-ca\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.286027 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.285981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrd8z\" (UniqueName: \"kubernetes.io/projected/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-kube-api-access-vrd8z\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.386665 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.386551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrd8z\" (UniqueName: \"kubernetes.io/projected/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-kube-api-access-vrd8z\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.387097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.386665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-maas-api-tls\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.387097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.386727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-openshift-service-ca\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.387469 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.387444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-openshift-service-ca\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.389251 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.389225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-maas-api-tls\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.396752 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.396732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrd8z\" (UniqueName: \"kubernetes.io/projected/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-kube-api-access-vrd8z\") pod \"maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.417898 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.417875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:19.529936 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.529902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:19.680055 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.680033    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"]
Jul 27 21:31:19.681950 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:31:19.681913    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa47a7ed_ed2e_4aaf_b0fe_2ba11e92c39e.slice/crio-b10ad0e3d9da1d46127b33d4aa60727ca83a7f7b9bd1162e1ade398cfe0438b7 WatchSource:0}: Error finding container b10ad0e3d9da1d46127b33d4aa60727ca83a7f7b9bd1162e1ade398cfe0438b7: Status 404 returned error can't find the container with id b10ad0e3d9da1d46127b33d4aa60727ca83a7f7b9bd1162e1ade398cfe0438b7
Jul 27 21:31:19.840312 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.840265    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:19.937960 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.937882    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"]
Jul 27 21:31:19.939581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.939554    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:19.942521 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.942505    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:19.944966 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.944947    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-51e5669d\""
Jul 27 21:31:19.955064 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.955044    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"]
Jul 27 21:31:19.991242 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.991211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239deeee-2db8-4b30-8e88-6020ba689301-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:19.991242 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:19.991243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjt9k\" (UniqueName: \"kubernetes.io/projected/239deeee-2db8-4b30-8e88-6020ba689301-kube-api-access-tjt9k\") pod \"payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:20.093085 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.092125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239deeee-2db8-4b30-8e88-6020ba689301-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:20.093085 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.092171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjt9k\" (UniqueName: \"kubernetes.io/projected/239deeee-2db8-4b30-8e88-6020ba689301-kube-api-access-tjt9k\") pod \"payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:20.093432 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.093399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239deeee-2db8-4b30-8e88-6020ba689301-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:20.100984 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.100962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjt9k\" (UniqueName: \"kubernetes.io/projected/239deeee-2db8-4b30-8e88-6020ba689301-kube-api-access-tjt9k\") pod \"payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:20.254196 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.254151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:20.393401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.393375    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"]
Jul 27 21:31:20.394504 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:31:20.394474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239deeee_2db8_4b30_8e88_6020ba689301.slice/crio-72dc263178d4ae42cb792aebd24141ae14961aa21d9e6cd28c93d1cc5c605080 WatchSource:0}: Error finding container 72dc263178d4ae42cb792aebd24141ae14961aa21d9e6cd28c93d1cc5c605080: Status 404 returned error can't find the container with id 72dc263178d4ae42cb792aebd24141ae14961aa21d9e6cd28c93d1cc5c605080
Jul 27 21:31:20.471378 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.471351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg" event={"ID":"239deeee-2db8-4b30-8e88-6020ba689301","Type":"ContainerStarted","Data":"a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370"}
Jul 27 21:31:20.471498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.471407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg" event={"ID":"239deeee-2db8-4b30-8e88-6020ba689301","Type":"ContainerStarted","Data":"72dc263178d4ae42cb792aebd24141ae14961aa21d9e6cd28c93d1cc5c605080"}
Jul 27 21:31:20.471498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.471433    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:20.472968 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.472941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78" event={"ID":"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e","Type":"ContainerStarted","Data":"8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f"}
Jul 27 21:31:20.473062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.472991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78" event={"ID":"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e","Type":"ContainerStarted","Data":"b10ad0e3d9da1d46127b33d4aa60727ca83a7f7b9bd1162e1ade398cfe0438b7"}
Jul 27 21:31:20.473062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.473013    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:20.490764 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.490720    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg" podStartSLOduration=1.490699269 podStartE2EDuration="1.490699269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:31:20.488121125 +0000 UTC m=+2026.648511484" watchObservedRunningTime="2026-07-27 21:31:20.490699269 +0000 UTC m=+2026.651089629"
Jul 27 21:31:20.509900 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:20.509853    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78" podStartSLOduration=1.004704245 podStartE2EDuration="1.50983771s" totalImagesPullingTime="505.133465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:31:20.507221241 +0000 UTC m=+2026.667611602" watchObservedRunningTime="2026-07-27 21:31:20.50983771 +0000 UTC m=+2026.670228075"
Jul 27 21:31:26.484476 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:26.484438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:28.463399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:28.463361    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:31:31.481080 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:31.481052    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:44.075423 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.075387    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"]
Jul 27 21:31:44.078969 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.078953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"
Jul 27 21:31:44.081878 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.081853    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:31:44.087557 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.087532    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"]
Jul 27 21:31:44.193643 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.193591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404b9bd5-211e-47fc-ae2b-22804a7d3687-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8\" (UID: \"404b9bd5-211e-47fc-ae2b-22804a7d3687\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"
Jul 27 21:31:44.294571 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.294529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404b9bd5-211e-47fc-ae2b-22804a7d3687-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8\" (UID: \"404b9bd5-211e-47fc-ae2b-22804a7d3687\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"
Jul 27 21:31:44.295171 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.295149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404b9bd5-211e-47fc-ae2b-22804a7d3687-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8\" (UID: \"404b9bd5-211e-47fc-ae2b-22804a7d3687\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"
Jul 27 21:31:44.391748 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.391669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"
Jul 27 21:31:44.533261 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.533231    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"]
Jul 27 21:31:44.535364 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:31:44.535335    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404b9bd5_211e_47fc_ae2b_22804a7d3687.slice/crio-b9cab3c506eb44404c81cb9bf4635c4aac4738a50be5c02ec15f479e0499aaf3 WatchSource:0}: Error finding container b9cab3c506eb44404c81cb9bf4635c4aac4738a50be5c02ec15f479e0499aaf3: Status 404 returned error can't find the container with id b9cab3c506eb44404c81cb9bf4635c4aac4738a50be5c02ec15f479e0499aaf3
Jul 27 21:31:44.615037 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:44.614998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8" event={"ID":"404b9bd5-211e-47fc-ae2b-22804a7d3687","Type":"ContainerStarted","Data":"b9cab3c506eb44404c81cb9bf4635c4aac4738a50be5c02ec15f479e0499aaf3"}
Jul 27 21:31:45.629494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:45.629457    2579 generic.go:356] "Generic (PLEG): container finished" podID="404b9bd5-211e-47fc-ae2b-22804a7d3687" containerID="e448b97138af41b6c58f970000340ba81d7982f7345b3faa47d2eaacb65f4da6" exitCode=0
Jul 27 21:31:45.629930 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:45.629517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8" event={"ID":"404b9bd5-211e-47fc-ae2b-22804a7d3687","Type":"ContainerDied","Data":"e448b97138af41b6c58f970000340ba81d7982f7345b3faa47d2eaacb65f4da6"}
Jul 27 21:31:46.773617 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:46.773572    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"
Jul 27 21:31:46.918169 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:46.918077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404b9bd5-211e-47fc-ae2b-22804a7d3687-maas-api-service-ca\") pod \"404b9bd5-211e-47fc-ae2b-22804a7d3687\" (UID: \"404b9bd5-211e-47fc-ae2b-22804a7d3687\") "
Jul 27 21:31:46.918424 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:46.918402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404b9bd5-211e-47fc-ae2b-22804a7d3687-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "404b9bd5-211e-47fc-ae2b-22804a7d3687" (UID: "404b9bd5-211e-47fc-ae2b-22804a7d3687"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:47.019059 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:47.019028    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404b9bd5-211e-47fc-ae2b-22804a7d3687-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:47.641303 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:47.641273    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"
Jul 27 21:31:47.641478 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:47.641272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8" event={"ID":"404b9bd5-211e-47fc-ae2b-22804a7d3687","Type":"ContainerDied","Data":"b9cab3c506eb44404c81cb9bf4635c4aac4738a50be5c02ec15f479e0499aaf3"}
Jul 27 21:31:47.641478 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:47.641401    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9cab3c506eb44404c81cb9bf4635c4aac4738a50be5c02ec15f479e0499aaf3"
Jul 27 21:31:54.665545 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.665453    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"]
Jul 27 21:31:54.666023 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.665750    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78" podUID="aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" containerName="maas-api" containerID="cri-o://8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f" gracePeriod=30
Jul 27 21:31:54.698076 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.698047    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:54.765011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.764983    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"]
Jul 27 21:31:54.765221 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.765198    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg" podUID="239deeee-2db8-4b30-8e88-6020ba689301" containerName="payload-pre-processing" containerID="cri-o://a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370" gracePeriod=30
Jul 27 21:31:54.818303 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.818260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:54.905496 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.905467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:54.915089 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:54.915059    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:55.005569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.005532    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"]
Jul 27 21:31:55.008112 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.008087    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-51e5669d-ng8b8"]
Jul 27 21:31:55.008962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.008928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:55.017160 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.017135    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:55.082654 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.082629    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-openshift-service-ca\") pod \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") "
Jul 27 21:31:55.082782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.082720    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrd8z\" (UniqueName: \"kubernetes.io/projected/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-kube-api-access-vrd8z\") pod \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") "
Jul 27 21:31:55.082782 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.082752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-maas-api-tls\") pod \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\" (UID: \"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e\") "
Jul 27 21:31:55.083027 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.083000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" (UID: "aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:55.084985 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.084963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-kube-api-access-vrd8z" (OuterVolumeSpecName: "kube-api-access-vrd8z") pod "aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" (UID: "aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e"). InnerVolumeSpecName "kube-api-access-vrd8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:55.084985 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.084979    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" (UID: "aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:31:55.183290 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.183262    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjt9k\" (UniqueName: \"kubernetes.io/projected/239deeee-2db8-4b30-8e88-6020ba689301-kube-api-access-tjt9k\") pod \"239deeee-2db8-4b30-8e88-6020ba689301\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") "
Jul 27 21:31:55.183408 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.183306    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239deeee-2db8-4b30-8e88-6020ba689301-plugins-config-volume\") pod \"239deeee-2db8-4b30-8e88-6020ba689301\" (UID: \"239deeee-2db8-4b30-8e88-6020ba689301\") "
Jul 27 21:31:55.183497 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.183483    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrd8z\" (UniqueName: \"kubernetes.io/projected/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-kube-api-access-vrd8z\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:55.183559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.183499    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:55.183559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.183507    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:55.183736 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.183713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/239deeee-2db8-4b30-8e88-6020ba689301-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "239deeee-2db8-4b30-8e88-6020ba689301" (UID: "239deeee-2db8-4b30-8e88-6020ba689301"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:55.185489 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.185468    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/239deeee-2db8-4b30-8e88-6020ba689301-kube-api-access-tjt9k" (OuterVolumeSpecName: "kube-api-access-tjt9k") pod "239deeee-2db8-4b30-8e88-6020ba689301" (UID: "239deeee-2db8-4b30-8e88-6020ba689301"). InnerVolumeSpecName "kube-api-access-tjt9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:55.201816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.201738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:55.284721 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.284695    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239deeee-2db8-4b30-8e88-6020ba689301-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:55.284721 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.284725    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjt9k\" (UniqueName: \"kubernetes.io/projected/239deeee-2db8-4b30-8e88-6020ba689301-kube-api-access-tjt9k\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:31:55.483984 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.483898    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:55.687067 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.687046    2579 generic.go:356] "Generic (PLEG): container finished" podID="239deeee-2db8-4b30-8e88-6020ba689301" containerID="a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370" exitCode=0
Jul 27 21:31:55.687383 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.687093    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"
Jul 27 21:31:55.687383 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.687134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg" event={"ID":"239deeee-2db8-4b30-8e88-6020ba689301","Type":"ContainerDied","Data":"a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370"}
Jul 27 21:31:55.687383 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.687187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg" event={"ID":"239deeee-2db8-4b30-8e88-6020ba689301","Type":"ContainerDied","Data":"72dc263178d4ae42cb792aebd24141ae14961aa21d9e6cd28c93d1cc5c605080"}
Jul 27 21:31:55.687383 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.687215    2579 scope.go:117] "RemoveContainer" containerID="a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370"
Jul 27 21:31:55.688574 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.688530    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" containerID="8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f" exitCode=0
Jul 27 21:31:55.688574 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.688565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78" event={"ID":"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e","Type":"ContainerDied","Data":"8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f"}
Jul 27 21:31:55.688693 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.688581    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"
Jul 27 21:31:55.688693 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.688618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78" event={"ID":"aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e","Type":"ContainerDied","Data":"b10ad0e3d9da1d46127b33d4aa60727ca83a7f7b9bd1162e1ade398cfe0438b7"}
Jul 27 21:31:55.697495 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.697477    2579 scope.go:117] "RemoveContainer" containerID="a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370"
Jul 27 21:31:55.697786 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:31:55.697763    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370\": container with ID starting with a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370 not found: ID does not exist" containerID="a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370"
Jul 27 21:31:55.697857 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.697794    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370"} err="failed to get container status \"a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370\": rpc error: code = NotFound desc = could not find container \"a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370\": container with ID starting with a87f6798f176a6986900379f02d7b39969f61acb6862989666a1c6aab844b370 not found: ID does not exist"
Jul 27 21:31:55.697857 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.697817    2579 scope.go:117] "RemoveContainer" containerID="8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f"
Jul 27 21:31:55.706357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.706340    2579 scope.go:117] "RemoveContainer" containerID="8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f"
Jul 27 21:31:55.706589 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:31:55.706571    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f\": container with ID starting with 8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f not found: ID does not exist" containerID="8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f"
Jul 27 21:31:55.706672 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.706611    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f"} err="failed to get container status \"8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f\": rpc error: code = NotFound desc = could not find container \"8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f\": container with ID starting with 8db98fc8ec77ee439f6a86aa21392ec09415740a36f7a0db0631084c3e46223f not found: ID does not exist"
Jul 27 21:31:55.710858 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.710838    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"]
Jul 27 21:31:55.715311 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.715291    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51e5669d-875dc4648-zvntg"]
Jul 27 21:31:55.728876 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.728847    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"]
Jul 27 21:31:55.734490 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:55.734440    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51e5669d-756d7c7b9d-7md78"]
Jul 27 21:31:56.020459 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:56.020423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:56.113810 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:56.113785    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:56.217872 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:56.217844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:56.388991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:56.388926    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="239deeee-2db8-4b30-8e88-6020ba689301" path="/var/lib/kubelet/pods/239deeee-2db8-4b30-8e88-6020ba689301/volumes"
Jul 27 21:31:56.389286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:56.389271    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="404b9bd5-211e-47fc-ae2b-22804a7d3687" path="/var/lib/kubelet/pods/404b9bd5-211e-47fc-ae2b-22804a7d3687/volumes"
Jul 27 21:31:56.389638 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:56.389626    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" path="/var/lib/kubelet/pods/aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e/volumes"
Jul 27 21:31:57.773158 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:57.773124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:31:58.954685 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:31:58.954648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:32:03.513674 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:03.513636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:03.569735 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:03.569703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:03.653236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:03.653205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:03.753456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:03.753414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:03.854417 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:03.854393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:04.263667 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:04.263562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:09.873534 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:09.873502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:32:30.285003 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:30.284965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:34.490594 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:34.490567    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:32:34.495785 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:34.495765    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:32:36.402494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:36.402453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:36.502826 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:36.502792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:36.602761 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:36.602724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:36.704900 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:36.704818    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:52.656484 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:52.656443    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:58.314171 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:58.314130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:58.470741 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:58.470697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:58.574546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:58.574466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:32:58.671415 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:32:58.671375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:05.563555 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:05.563525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:06.919901 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:06.919862    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:09.328853 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:09.328800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:10.238813 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:10.238773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:16.400277 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:16.400231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:16.504945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:16.504905    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:16.649354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:16.649295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:16.791102 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:16.791070    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:17.677519 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:17.677471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:17.776257 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:17.776215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:17.896248 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:17.896210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:19.603481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:19.603447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:21.245911 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:21.245873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:33:25.687270 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:25.687153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:25.795304 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:25.795260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:26.408722 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:26.408682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:31.039418 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:31.039384    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:33:32.282193 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:32.282155    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:32.343778 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:32.343745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:32.556058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:32.555984    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:32.899637 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:32.899525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:33.032842 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:33.032811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:36.122269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:36.122226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:36.215789 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:36.215748    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:36.290163 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:36.290126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:36.760219 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:36.760173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:36.907670 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:36.907631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:37.024421 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.024377    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:37.216699 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.216664    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"]
Jul 27 21:33:37.217245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217224    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" containerName="maas-api"
Jul 27 21:33:37.217344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217249    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" containerName="maas-api"
Jul 27 21:33:37.217344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217263    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239deeee-2db8-4b30-8e88-6020ba689301" containerName="payload-pre-processing"
Jul 27 21:33:37.217344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217272    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="239deeee-2db8-4b30-8e88-6020ba689301" containerName="payload-pre-processing"
Jul 27 21:33:37.217344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217284    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404b9bd5-211e-47fc-ae2b-22804a7d3687" containerName="revoke-keys"
Jul 27 21:33:37.217344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217292    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="404b9bd5-211e-47fc-ae2b-22804a7d3687" containerName="revoke-keys"
Jul 27 21:33:37.217707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217398    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="239deeee-2db8-4b30-8e88-6020ba689301" containerName="payload-pre-processing"
Jul 27 21:33:37.217707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217418    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa47a7ed-ed2e-4aaf-b0fe-2ba11e92c39e" containerName="maas-api"
Jul 27 21:33:37.217707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.217428    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="404b9bd5-211e-47fc-ae2b-22804a7d3687" containerName="revoke-keys"
Jul 27 21:33:37.220994 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.220958    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.223439 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.223405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a3fb0814-dockercfg-rmfbv\""
Jul 27 21:33:37.223584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.223438    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a3fb0814\""
Jul 27 21:33:37.227819 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.227788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"]
Jul 27 21:33:37.360826 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.360730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-plugins-config-volume\") pod \"payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") " pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.360997 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.360863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8b7h\" (UniqueName: \"kubernetes.io/projected/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-kube-api-access-p8b7h\") pod \"payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") " pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.466863 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.466692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8b7h\" (UniqueName: \"kubernetes.io/projected/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-kube-api-access-p8b7h\") pod \"payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") " pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.467080 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.466964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-plugins-config-volume\") pod \"payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") " pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.467796 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.467771    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-plugins-config-volume\") pod \"payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") " pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.478357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.478325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8b7h\" (UniqueName: \"kubernetes.io/projected/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-kube-api-access-p8b7h\") pod \"payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") " pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.534230 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.534189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:37.673910 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:37.673880    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"]
Jul 27 21:33:37.675493 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:33:37.675462    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84be7aed_49c3_4b93_bdb7_0419ebe79ae5.slice/crio-9a6ea6c6efbeb0235beb060d6d2a01b659095de5daef8a5d86d25190181df607 WatchSource:0}: Error finding container 9a6ea6c6efbeb0235beb060d6d2a01b659095de5daef8a5d86d25190181df607: Status 404 returned error can't find the container with id 9a6ea6c6efbeb0235beb060d6d2a01b659095de5daef8a5d86d25190181df607
Jul 27 21:33:38.273513 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:38.273478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b" event={"ID":"84be7aed-49c3-4b93-bdb7-0419ebe79ae5","Type":"ContainerStarted","Data":"dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336"}
Jul 27 21:33:38.273920 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:38.273535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b" event={"ID":"84be7aed-49c3-4b93-bdb7-0419ebe79ae5","Type":"ContainerStarted","Data":"9a6ea6c6efbeb0235beb060d6d2a01b659095de5daef8a5d86d25190181df607"}
Jul 27 21:33:38.273920 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:38.273570    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:38.293153 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:38.293102    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b" podStartSLOduration=1.293086945 podStartE2EDuration="1.293086945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:33:38.290402096 +0000 UTC m=+2164.450792465" watchObservedRunningTime="2026-07-27 21:33:38.293086945 +0000 UTC m=+2164.453477313"
Jul 27 21:33:40.575155 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:40.575107    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:40.945116 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:40.945035    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:33:41.271742 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:41.271707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:41.369061 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:41.369028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:41.749834 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:41.749747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:47.482610 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:47.482575    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:47.583737 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:47.583708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:47.864142 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:47.864117    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"]
Jul 27 21:33:47.867696 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:47.867680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"
Jul 27 21:33:47.870005 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:47.869977    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:33:47.870131 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:47.870023    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:33:47.874502 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:47.874477    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"]
Jul 27 21:33:48.052725 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:48.052700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afbef57b-0dc1-4ac2-b988-3f07272befd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5\" (UID: \"afbef57b-0dc1-4ac2-b988-3f07272befd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"
Jul 27 21:33:48.153140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:48.153079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afbef57b-0dc1-4ac2-b988-3f07272befd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5\" (UID: \"afbef57b-0dc1-4ac2-b988-3f07272befd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"
Jul 27 21:33:48.153693 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:48.153677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afbef57b-0dc1-4ac2-b988-3f07272befd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5\" (UID: \"afbef57b-0dc1-4ac2-b988-3f07272befd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"
Jul 27 21:33:48.180160 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:48.180139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"
Jul 27 21:33:48.313977 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:48.313953    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"]
Jul 27 21:33:48.316075 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:33:48.316048    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbef57b_0dc1_4ac2_b988_3f07272befd0.slice/crio-78e2122c61fb72e28966102f743af525ab94923cece38460cabe622fa3a9b4e3 WatchSource:0}: Error finding container 78e2122c61fb72e28966102f743af525ab94923cece38460cabe622fa3a9b4e3: Status 404 returned error can't find the container with id 78e2122c61fb72e28966102f743af525ab94923cece38460cabe622fa3a9b4e3
Jul 27 21:33:48.337743 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:48.337717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5" event={"ID":"afbef57b-0dc1-4ac2-b988-3f07272befd0","Type":"ContainerStarted","Data":"78e2122c61fb72e28966102f743af525ab94923cece38460cabe622fa3a9b4e3"}
Jul 27 21:33:49.281170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:49.281143    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:49.346233 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:49.346199    2579 generic.go:356] "Generic (PLEG): container finished" podID="afbef57b-0dc1-4ac2-b988-3f07272befd0" containerID="40a80094effcf08e0e0ad19cd92a6f8977a798bc3134a41009f551c92fe22688" exitCode=0
Jul 27 21:33:49.346373 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:49.346241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5" event={"ID":"afbef57b-0dc1-4ac2-b988-3f07272befd0","Type":"ContainerDied","Data":"40a80094effcf08e0e0ad19cd92a6f8977a798bc3134a41009f551c92fe22688"}
Jul 27 21:33:50.484828 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:50.484805    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"
Jul 27 21:33:50.669906 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:50.669837    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afbef57b-0dc1-4ac2-b988-3f07272befd0-maas-api-service-ca\") pod \"afbef57b-0dc1-4ac2-b988-3f07272befd0\" (UID: \"afbef57b-0dc1-4ac2-b988-3f07272befd0\") "
Jul 27 21:33:50.670213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:50.670188    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbef57b-0dc1-4ac2-b988-3f07272befd0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afbef57b-0dc1-4ac2-b988-3f07272befd0" (UID: "afbef57b-0dc1-4ac2-b988-3f07272befd0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:33:50.770925 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:50.770899    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afbef57b-0dc1-4ac2-b988-3f07272befd0-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:33:51.359221 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:51.359193    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"
Jul 27 21:33:51.359376 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:51.359211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5" event={"ID":"afbef57b-0dc1-4ac2-b988-3f07272befd0","Type":"ContainerDied","Data":"78e2122c61fb72e28966102f743af525ab94923cece38460cabe622fa3a9b4e3"}
Jul 27 21:33:51.359376 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:51.359267    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78e2122c61fb72e28966102f743af525ab94923cece38460cabe622fa3a9b4e3"
Jul 27 21:33:58.296979 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.296942    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:58.328016 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.327986    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"]
Jul 27 21:33:58.328287 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.328251    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b" podUID="84be7aed-49c3-4b93-bdb7-0419ebe79ae5" containerName="payload-processing" containerID="cri-o://dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336" gracePeriod=30
Jul 27 21:33:58.397798 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.397765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:58.465927 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.465888    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"]
Jul 27 21:33:58.467581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.467548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:58.468500 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.468478    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3fb0814-fhqg5"]
Jul 27 21:33:58.522061 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.522030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:58.589680 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.589651    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:58.639251 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.639219    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8b7h\" (UniqueName: \"kubernetes.io/projected/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-kube-api-access-p8b7h\") pod \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") "
Jul 27 21:33:58.639441 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.639295    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-plugins-config-volume\") pod \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\" (UID: \"84be7aed-49c3-4b93-bdb7-0419ebe79ae5\") "
Jul 27 21:33:58.639713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.639680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84be7aed-49c3-4b93-bdb7-0419ebe79ae5" (UID: "84be7aed-49c3-4b93-bdb7-0419ebe79ae5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:33:58.641530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.641511    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-kube-api-access-p8b7h" (OuterVolumeSpecName: "kube-api-access-p8b7h") pod "84be7aed-49c3-4b93-bdb7-0419ebe79ae5" (UID: "84be7aed-49c3-4b93-bdb7-0419ebe79ae5"). InnerVolumeSpecName "kube-api-access-p8b7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:33:58.740820 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.740785    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8b7h\" (UniqueName: \"kubernetes.io/projected/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-kube-api-access-p8b7h\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:33:58.740820 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.740812    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84be7aed-49c3-4b93-bdb7-0419ebe79ae5-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:33:58.863034 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:58.862935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:33:59.414211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.414178    2579 generic.go:356] "Generic (PLEG): container finished" podID="84be7aed-49c3-4b93-bdb7-0419ebe79ae5" containerID="dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336" exitCode=0
Jul 27 21:33:59.414717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.414235    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"
Jul 27 21:33:59.414717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.414269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b" event={"ID":"84be7aed-49c3-4b93-bdb7-0419ebe79ae5","Type":"ContainerDied","Data":"dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336"}
Jul 27 21:33:59.414717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.414338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b" event={"ID":"84be7aed-49c3-4b93-bdb7-0419ebe79ae5","Type":"ContainerDied","Data":"9a6ea6c6efbeb0235beb060d6d2a01b659095de5daef8a5d86d25190181df607"}
Jul 27 21:33:59.414717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.414374    2579 scope.go:117] "RemoveContainer" containerID="dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336"
Jul 27 21:33:59.426794 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.426774    2579 scope.go:117] "RemoveContainer" containerID="dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336"
Jul 27 21:33:59.427398 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:33:59.427376    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336\": container with ID starting with dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336 not found: ID does not exist" containerID="dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336"
Jul 27 21:33:59.427474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.427412    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336"} err="failed to get container status \"dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336\": rpc error: code = NotFound desc = could not find container \"dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336\": container with ID starting with dca4b1022cbf5c0fca0c4893a432e94214bb4523bfa565daa897ecc8a2603336 not found: ID does not exist"
Jul 27 21:33:59.438876 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.438852    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"]
Jul 27 21:33:59.443031 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:33:59.443012    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a3fb0814-6bbf99c4c4-mbl7b"]
Jul 27 21:34:00.389223 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:00.389190    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84be7aed-49c3-4b93-bdb7-0419ebe79ae5" path="/var/lib/kubelet/pods/84be7aed-49c3-4b93-bdb7-0419ebe79ae5/volumes"
Jul 27 21:34:00.389523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:00.389510    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afbef57b-0dc1-4ac2-b988-3f07272befd0" path="/var/lib/kubelet/pods/afbef57b-0dc1-4ac2-b988-3f07272befd0/volumes"
Jul 27 21:34:01.047976 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:01.047940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:34:04.597182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:04.597146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:04.649625 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:04.649569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:04.872737 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:04.872646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:05.119588 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:05.119536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:05.257543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:05.257453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:05.342958 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:05.342921    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:05.481996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:05.481949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:11.198469 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:11.198426    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:11.275122 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:11.275092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:11.352742 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:11.352705    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:11.452715 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:11.452632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:11.599183 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:11.599148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:17.217545 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:17.217509    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:17.274961 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:17.274933    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:24.250082 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:24.250030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:24.607759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:24.607725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:24.827591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:24.827553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:27.764922 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:27.764881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:27.830659 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:27.830628    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:28.014679 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.014647    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:28.398401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.398367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:28.500573 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.500543    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:28.600559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.600533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:28.677703 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.677627    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:28.682713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.682691    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"]
Jul 27 21:34:28.683059 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.683047    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbef57b-0dc1-4ac2-b988-3f07272befd0" containerName="revoke-keys"
Jul 27 21:34:28.683104 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.683061    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbef57b-0dc1-4ac2-b988-3f07272befd0" containerName="revoke-keys"
Jul 27 21:34:28.683104 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.683076    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84be7aed-49c3-4b93-bdb7-0419ebe79ae5" containerName="payload-processing"
Jul 27 21:34:28.683104 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.683081    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="84be7aed-49c3-4b93-bdb7-0419ebe79ae5" containerName="payload-processing"
Jul 27 21:34:28.683207 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.683133    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="84be7aed-49c3-4b93-bdb7-0419ebe79ae5" containerName="payload-processing"
Jul 27 21:34:28.683207 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.683141    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbef57b-0dc1-4ac2-b988-3f07272befd0" containerName="revoke-keys"
Jul 27 21:34:28.686300 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.686285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:28.688797 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.688778    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-62de4959-dockercfg-h872w\""
Jul 27 21:34:28.688934 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.688785    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-62de4959\""
Jul 27 21:34:28.697020 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.696994    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"]
Jul 27 21:34:28.780187 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.780162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d8f57da-712c-4050-a3e3-e8ca3af21be9-plugins-config-volume\") pod \"payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") " pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:28.780526 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.780208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkjpp\" (UniqueName: \"kubernetes.io/projected/5d8f57da-712c-4050-a3e3-e8ca3af21be9-kube-api-access-wkjpp\") pod \"payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") " pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:28.881118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.881090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d8f57da-712c-4050-a3e3-e8ca3af21be9-plugins-config-volume\") pod \"payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") " pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:28.881243 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.881131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkjpp\" (UniqueName: \"kubernetes.io/projected/5d8f57da-712c-4050-a3e3-e8ca3af21be9-kube-api-access-wkjpp\") pod \"payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") " pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:28.881799 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.881780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d8f57da-712c-4050-a3e3-e8ca3af21be9-plugins-config-volume\") pod \"payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") " pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:28.889288 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.889257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkjpp\" (UniqueName: \"kubernetes.io/projected/5d8f57da-712c-4050-a3e3-e8ca3af21be9-kube-api-access-wkjpp\") pod \"payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") " pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:28.998447 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:28.998389    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:29.133290 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:29.133261    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"]
Jul 27 21:34:29.135332 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:34:29.135310    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8f57da_712c_4050_a3e3_e8ca3af21be9.slice/crio-304aedc1336eb02e6e34a2d0685c426ad2a81bebfed409e84233c5c13a5695e8 WatchSource:0}: Error finding container 304aedc1336eb02e6e34a2d0685c426ad2a81bebfed409e84233c5c13a5695e8: Status 404 returned error can't find the container with id 304aedc1336eb02e6e34a2d0685c426ad2a81bebfed409e84233c5c13a5695e8
Jul 27 21:34:29.589068 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:29.589033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn" event={"ID":"5d8f57da-712c-4050-a3e3-e8ca3af21be9","Type":"ContainerStarted","Data":"ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a"}
Jul 27 21:34:29.589245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:29.589188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:29.589245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:29.589219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn" event={"ID":"5d8f57da-712c-4050-a3e3-e8ca3af21be9","Type":"ContainerStarted","Data":"304aedc1336eb02e6e34a2d0685c426ad2a81bebfed409e84233c5c13a5695e8"}
Jul 27 21:34:29.606281 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:29.606239    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn" podStartSLOduration=1.606226689 podStartE2EDuration="1.606226689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:29.604099271 +0000 UTC m=+2215.764489631" watchObservedRunningTime="2026-07-27 21:34:29.606226689 +0000 UTC m=+2215.766617067"
Jul 27 21:34:32.346964 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:32.346931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:34.845621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:34.845511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:34:40.598016 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:40.597989    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:34:44.812227 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.812190    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"]
Jul 27 21:34:44.815852 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.815829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:44.818311 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.818283    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-62de4959\"/\"kube-root-ca.crt\""
Jul 27 21:34:44.819267 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.819089    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-62de4959\"/\"default-dockercfg-4lk7m\""
Jul 27 21:34:44.819267 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.819155    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-62de4959\"/\"openshift-service-ca.crt\""
Jul 27 21:34:44.819267 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.819161    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-62de4959\"/\"e2e-lifecycle-model-62de4959-kserve-self-signed-certs\""
Jul 27 21:34:44.825455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.825431    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"]
Jul 27 21:34:44.849867 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.849840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:34:44.908657 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.908633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tmp-dir\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:44.908776 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.908691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tls-certs\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:44.908835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.908797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4p9j\" (UniqueName: \"kubernetes.io/projected/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-kube-api-access-r4p9j\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:44.908877 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.908839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-home\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:44.908877 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.908862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-dshm\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:44.908987 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:44.908885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-model-cache\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.009587 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.009558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-home\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.009713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.009590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-dshm\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.009713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.009622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-model-cache\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.009713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.009660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tmp-dir\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.009713 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.009689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tls-certs\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.009928 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.009722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4p9j\" (UniqueName: \"kubernetes.io/projected/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-kube-api-access-r4p9j\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.010018 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.009995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-home\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.010116 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.010091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tmp-dir\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.010174 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.010112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-model-cache\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.012152 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.012134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-dshm\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.012328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.012309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tls-certs\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.017237 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.017214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4p9j\" (UniqueName: \"kubernetes.io/projected/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-kube-api-access-r4p9j\") pod \"e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") " pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.126653 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.126587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:45.267768 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.267737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"]
Jul 27 21:34:45.269037 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:34:45.269007    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca0668c9_87cf_4883_bdfd_e023f8bbdacb.slice/crio-cf93f2b6c1339914976448bc20308a41cd7a9ce3e4f555a87bd90dfb81793eda WatchSource:0}: Error finding container cf93f2b6c1339914976448bc20308a41cd7a9ce3e4f555a87bd90dfb81793eda: Status 404 returned error can't find the container with id cf93f2b6c1339914976448bc20308a41cd7a9ce3e4f555a87bd90dfb81793eda
Jul 27 21:34:45.684783 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.684750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf" event={"ID":"ca0668c9-87cf-4883-bdfd-e023f8bbdacb","Type":"ContainerStarted","Data":"238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410"}
Jul 27 21:34:45.684946 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.684795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf" event={"ID":"ca0668c9-87cf-4883-bdfd-e023f8bbdacb","Type":"ContainerStarted","Data":"cf93f2b6c1339914976448bc20308a41cd7a9ce3e4f555a87bd90dfb81793eda"}
Jul 27 21:34:45.702962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:45.702916    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf" podStartSLOduration=1.702901615 podStartE2EDuration="1.702901615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:45.702291884 +0000 UTC m=+2231.862682244" watchObservedRunningTime="2026-07-27 21:34:45.702901615 +0000 UTC m=+2231.863291973"
Jul 27 21:34:47.747877 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:47.747847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:34:55.127759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:55.127659    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:55.127759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:55.127716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:55.140473 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:55.140444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:34:55.751947 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:34:55.751919    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:35:09.941288 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:09.941258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:35:17.427326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.427286    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"]
Jul 27 21:35:17.430936 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.430919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"
Jul 27 21:35:17.433359 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.433324    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:35:17.433359 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.433342    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:35:17.438301 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.438276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"]
Jul 27 21:35:17.465968 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.465945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba53ab2c-cc4c-4921-98d1-ba5e5ece674e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-62de4959-ftb8w\" (UID: \"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"
Jul 27 21:35:17.567476 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.567449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba53ab2c-cc4c-4921-98d1-ba5e5ece674e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-62de4959-ftb8w\" (UID: \"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"
Jul 27 21:35:17.568039 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.568017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba53ab2c-cc4c-4921-98d1-ba5e5ece674e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-62de4959-ftb8w\" (UID: \"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"
Jul 27 21:35:17.744979 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.744922    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"
Jul 27 21:35:17.880399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:17.880370    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"]
Jul 27 21:35:17.883212 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:35:17.883181    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba53ab2c_cc4c_4921_98d1_ba5e5ece674e.slice/crio-eb56f1fd59a0ae6a970f079ee941ec126c72482150c5d6413ebb11d0942843d6 WatchSource:0}: Error finding container eb56f1fd59a0ae6a970f079ee941ec126c72482150c5d6413ebb11d0942843d6: Status 404 returned error can't find the container with id eb56f1fd59a0ae6a970f079ee941ec126c72482150c5d6413ebb11d0942843d6
Jul 27 21:35:18.874760 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:18.874724    2579 generic.go:356] "Generic (PLEG): container finished" podID="ba53ab2c-cc4c-4921-98d1-ba5e5ece674e" containerID="da636b7e78f4e858710e1699326cfa5b491969f2e7ff177539d20b346bb55f37" exitCode=0
Jul 27 21:35:18.875099 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:18.874826    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w" event={"ID":"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e","Type":"ContainerDied","Data":"da636b7e78f4e858710e1699326cfa5b491969f2e7ff177539d20b346bb55f37"}
Jul 27 21:35:18.875099 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:18.874871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w" event={"ID":"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e","Type":"ContainerStarted","Data":"eb56f1fd59a0ae6a970f079ee941ec126c72482150c5d6413ebb11d0942843d6"}
Jul 27 21:35:20.015087 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:20.015065    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"
Jul 27 21:35:20.087436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:20.087399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba53ab2c-cc4c-4921-98d1-ba5e5ece674e-maas-api-service-ca\") pod \"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e\" (UID: \"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e\") "
Jul 27 21:35:20.087789 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:20.087764    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba53ab2c-cc4c-4921-98d1-ba5e5ece674e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba53ab2c-cc4c-4921-98d1-ba5e5ece674e" (UID: "ba53ab2c-cc4c-4921-98d1-ba5e5ece674e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:20.188436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:20.188374    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba53ab2c-cc4c-4921-98d1-ba5e5ece674e-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:20.888392 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:20.888355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w" event={"ID":"ba53ab2c-cc4c-4921-98d1-ba5e5ece674e","Type":"ContainerDied","Data":"eb56f1fd59a0ae6a970f079ee941ec126c72482150c5d6413ebb11d0942843d6"}
Jul 27 21:35:20.888392 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:20.888384    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"
Jul 27 21:35:20.888625 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:20.888414    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb56f1fd59a0ae6a970f079ee941ec126c72482150c5d6413ebb11d0942843d6"
Jul 27 21:35:31.452860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:31.452819    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:35:32.856182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:32.856147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:35:32.878404 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:32.878367    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"]
Jul 27 21:35:32.878678 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:32.878643    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn" podUID="5d8f57da-712c-4050-a3e3-e8ca3af21be9" containerName="payload-processing" containerID="cri-o://ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a" gracePeriod=30
Jul 27 21:35:32.956205 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:32.956179    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:35:33.005351 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.005321    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"]
Jul 27 21:35:33.007811 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.007783    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-62de4959-ftb8w"]
Jul 27 21:35:33.011289 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.011261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:35:33.135797 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.135776    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:35:33.188112 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.188090    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d8f57da-712c-4050-a3e3-e8ca3af21be9-plugins-config-volume\") pod \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") "
Jul 27 21:35:33.188245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.188229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkjpp\" (UniqueName: \"kubernetes.io/projected/5d8f57da-712c-4050-a3e3-e8ca3af21be9-kube-api-access-wkjpp\") pod \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\" (UID: \"5d8f57da-712c-4050-a3e3-e8ca3af21be9\") "
Jul 27 21:35:33.188409 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.188386    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d8f57da-712c-4050-a3e3-e8ca3af21be9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d8f57da-712c-4050-a3e3-e8ca3af21be9" (UID: "5d8f57da-712c-4050-a3e3-e8ca3af21be9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:33.188671 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.188655    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d8f57da-712c-4050-a3e3-e8ca3af21be9-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:33.190337 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.190318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d8f57da-712c-4050-a3e3-e8ca3af21be9-kube-api-access-wkjpp" (OuterVolumeSpecName: "kube-api-access-wkjpp") pod "5d8f57da-712c-4050-a3e3-e8ca3af21be9" (UID: "5d8f57da-712c-4050-a3e3-e8ca3af21be9"). InnerVolumeSpecName "kube-api-access-wkjpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:35:33.290072 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.290036    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkjpp\" (UniqueName: \"kubernetes.io/projected/5d8f57da-712c-4050-a3e3-e8ca3af21be9-kube-api-access-wkjpp\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:33.964715 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.964678    2579 generic.go:356] "Generic (PLEG): container finished" podID="5d8f57da-712c-4050-a3e3-e8ca3af21be9" containerID="ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a" exitCode=0
Jul 27 21:35:33.965071 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.964741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn" event={"ID":"5d8f57da-712c-4050-a3e3-e8ca3af21be9","Type":"ContainerDied","Data":"ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a"}
Jul 27 21:35:33.965071 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.964740    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"
Jul 27 21:35:33.965071 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.964837    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn" event={"ID":"5d8f57da-712c-4050-a3e3-e8ca3af21be9","Type":"ContainerDied","Data":"304aedc1336eb02e6e34a2d0685c426ad2a81bebfed409e84233c5c13a5695e8"}
Jul 27 21:35:33.965071 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.964869    2579 scope.go:117] "RemoveContainer" containerID="ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a"
Jul 27 21:35:33.974672 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.974656    2579 scope.go:117] "RemoveContainer" containerID="ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a"
Jul 27 21:35:33.974961 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:35:33.974943    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a\": container with ID starting with ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a not found: ID does not exist" containerID="ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a"
Jul 27 21:35:33.975040 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.974969    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a"} err="failed to get container status \"ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a\": rpc error: code = NotFound desc = could not find container \"ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a\": container with ID starting with ed1517f1c35c1a4711f3a75c11387680a2a87380f282515d7c4d089b0252a36a not found: ID does not exist"
Jul 27 21:35:33.987989 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.987970    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"]
Jul 27 21:35:33.990283 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:33.990262    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-62de4959-b5dbcb646-jvxqn"]
Jul 27 21:35:34.389415 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:34.389386    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d8f57da-712c-4050-a3e3-e8ca3af21be9" path="/var/lib/kubelet/pods/5d8f57da-712c-4050-a3e3-e8ca3af21be9/volumes"
Jul 27 21:35:34.389746 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:34.389724    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba53ab2c-cc4c-4921-98d1-ba5e5ece674e" path="/var/lib/kubelet/pods/ba53ab2c-cc4c-4921-98d1-ba5e5ece674e/volumes"
Jul 27 21:35:36.457035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:36.457000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:35:41.447075 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:41.447040    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"]
Jul 27 21:35:41.542536 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:41.542507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:35:41.735260 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:41.735190    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:35:56.467017 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.466966    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf" podUID="ca0668c9-87cf-4883-bdfd-e023f8bbdacb" containerName="main" containerID="cri-o://238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410" gracePeriod=45
Jul 27 21:35:56.716772 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.716749    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:35:56.881866 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.881836    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tmp-dir\") pod \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") "
Jul 27 21:35:56.882006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.881876    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-dshm\") pod \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") "
Jul 27 21:35:56.882006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.881915    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4p9j\" (UniqueName: \"kubernetes.io/projected/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-kube-api-access-r4p9j\") pod \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") "
Jul 27 21:35:56.882006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.881929    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-home\") pod \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") "
Jul 27 21:35:56.882006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.881974    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-model-cache\") pod \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") "
Jul 27 21:35:56.882006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.882000    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tls-certs\") pod \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\" (UID: \"ca0668c9-87cf-4883-bdfd-e023f8bbdacb\") "
Jul 27 21:35:56.882254 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.882138    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca0668c9-87cf-4883-bdfd-e023f8bbdacb" (UID: "ca0668c9-87cf-4883-bdfd-e023f8bbdacb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:35:56.882254 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.882215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca0668c9-87cf-4883-bdfd-e023f8bbdacb" (UID: "ca0668c9-87cf-4883-bdfd-e023f8bbdacb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:35:56.882364 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.882250    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-home" (OuterVolumeSpecName: "home") pod "ca0668c9-87cf-4883-bdfd-e023f8bbdacb" (UID: "ca0668c9-87cf-4883-bdfd-e023f8bbdacb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:35:56.882364 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.882272    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tmp-dir\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.884347 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.884324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-kube-api-access-r4p9j" (OuterVolumeSpecName: "kube-api-access-r4p9j") pod "ca0668c9-87cf-4883-bdfd-e023f8bbdacb" (UID: "ca0668c9-87cf-4883-bdfd-e023f8bbdacb"). InnerVolumeSpecName "kube-api-access-r4p9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:35:56.884476 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.884350    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-dshm" (OuterVolumeSpecName: "dshm") pod "ca0668c9-87cf-4883-bdfd-e023f8bbdacb" (UID: "ca0668c9-87cf-4883-bdfd-e023f8bbdacb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:35:56.884476 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.884430    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca0668c9-87cf-4883-bdfd-e023f8bbdacb" (UID: "ca0668c9-87cf-4883-bdfd-e023f8bbdacb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:35:56.983015 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.982990    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-dshm\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.983118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.983016    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4p9j\" (UniqueName: \"kubernetes.io/projected/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-kube-api-access-r4p9j\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.983118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.983029    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-home\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.983118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.983037    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-model-cache\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.983118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:56.983045    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0668c9-87cf-4883-bdfd-e023f8bbdacb-tls-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:35:57.119311 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.119283    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca0668c9-87cf-4883-bdfd-e023f8bbdacb" containerID="238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410" exitCode=0
Jul 27 21:35:57.119419 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.119333    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"
Jul 27 21:35:57.119419 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.119373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf" event={"ID":"ca0668c9-87cf-4883-bdfd-e023f8bbdacb","Type":"ContainerDied","Data":"238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410"}
Jul 27 21:35:57.119567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.119423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf" event={"ID":"ca0668c9-87cf-4883-bdfd-e023f8bbdacb","Type":"ContainerDied","Data":"cf93f2b6c1339914976448bc20308a41cd7a9ce3e4f555a87bd90dfb81793eda"}
Jul 27 21:35:57.119567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.119441    2579 scope.go:117] "RemoveContainer" containerID="238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410"
Jul 27 21:35:57.128675 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.128657    2579 scope.go:117] "RemoveContainer" containerID="238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410"
Jul 27 21:35:57.128923 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:35:57.128904    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410\": container with ID starting with 238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410 not found: ID does not exist" containerID="238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410"
Jul 27 21:35:57.128992 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.128930    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410"} err="failed to get container status \"238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410\": rpc error: code = NotFound desc = could not find container \"238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410\": container with ID starting with 238123b3f68eafe6ef5d1b636335c349524283cad15bb5473c722add5f584410 not found: ID does not exist"
Jul 27 21:35:57.138724 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.138671    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"]
Jul 27 21:35:57.142534 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:57.142514    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-62de4959/e2e-lifecycle-model-62de4959-kserve-66f5cb969f-jpwbf"]
Jul 27 21:35:58.389263 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:35:58.389233    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0668c9-87cf-4883-bdfd-e023f8bbdacb" path="/var/lib/kubelet/pods/ca0668c9-87cf-4883-bdfd-e023f8bbdacb/volumes"
Jul 27 21:36:18.302052 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:18.302019    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:18.508117 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:18.508086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:24.093224 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:24.093191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:34.597928 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:34.597895    2579 scope.go:117] "RemoveContainer" containerID="2d0be95ba6cd76209c8fe862a6bb679f9383f4150b083857264ab9b6407c9e21"
Jul 27 21:36:34.606732 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:34.606713    2579 scope.go:117] "RemoveContainer" containerID="5575d14c3efc577d2efaed2da20fe485866509dea85a05989b9a6c3df9f9280a"
Jul 27 21:36:34.614525 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:34.614507    2579 scope.go:117] "RemoveContainer" containerID="7dfda8b6d352e9ea1bcbf5afcaa85f8e7611d6c82b73b872562bc882b20ecd1d"
Jul 27 21:36:47.161564 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:47.161530    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:47.261799 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:47.261757    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:47.446051 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:47.445962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:47.711708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:47.711626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:48.868554 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:48.868514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:48.963593 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:48.963560    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:49.065981 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:49.065954    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:49.985394 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:49.985356    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:50.085244 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:50.085207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:51.147982 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:51.147946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:36:51.783591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:51.783550    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:57.283795 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:57.283758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:57.383862 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:57.383827    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:36:57.997347 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:36:57.997312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:00.652458 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:00.652415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:37:03.788907 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:03.788850    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:03.899781 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:03.899752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:03.989275 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:03.989240    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:09.526292 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:09.526249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:14.557111 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:14.557076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:14.931309 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:14.931228    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:34.529269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:34.529241    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:37:34.535505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:34.535483    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:37:34.646537 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:34.646507    2579 scope.go:117] "RemoveContainer" containerID="6de5ca1d6510b1ce6667af308303f6a1886944062bab7e5c46d1265f1a1d57f8"
Jul 27 21:37:35.958143 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:35.958100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:41.953549 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:41.953515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:42.054978 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:42.054938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:42.339032 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:42.338986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:42.659662 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:42.659565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:42.767721 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:42.767681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:45.888041 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:45.887990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:45.992895 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:45.992861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:46.136837 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.136805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:46.613529 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.613489    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:46.711787 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.711755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:46.794644 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.794578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:46.807814 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.807782    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"]
Jul 27 21:37:46.808189 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808175    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8f57da-712c-4050-a3e3-e8ca3af21be9" containerName="payload-processing"
Jul 27 21:37:46.808236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808191    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8f57da-712c-4050-a3e3-e8ca3af21be9" containerName="payload-processing"
Jul 27 21:37:46.808236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808206    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba53ab2c-cc4c-4921-98d1-ba5e5ece674e" containerName="revoke-keys"
Jul 27 21:37:46.808236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808212    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba53ab2c-cc4c-4921-98d1-ba5e5ece674e" containerName="revoke-keys"
Jul 27 21:37:46.808236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808219    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0668c9-87cf-4883-bdfd-e023f8bbdacb" containerName="main"
Jul 27 21:37:46.808236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808225    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0668c9-87cf-4883-bdfd-e023f8bbdacb" containerName="main"
Jul 27 21:37:46.808385 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808316    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8f57da-712c-4050-a3e3-e8ca3af21be9" containerName="payload-processing"
Jul 27 21:37:46.808385 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808330    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0668c9-87cf-4883-bdfd-e023f8bbdacb" containerName="main"
Jul 27 21:37:46.808385 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.808338    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba53ab2c-cc4c-4921-98d1-ba5e5ece674e" containerName="revoke-keys"
Jul 27 21:37:46.811459 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.811444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:46.814364 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.814340    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-16c965-dockercfg-zfwdd\""
Jul 27 21:37:46.814469 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.814456    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-16c965\""
Jul 27 21:37:46.825026 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.825004    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"]
Jul 27 21:37:46.878093 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.878009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dbcafd2-623c-4a02-a08d-4b77773fcccc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:46.878093 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.878058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xf44\" (UniqueName: \"kubernetes.io/projected/8dbcafd2-623c-4a02-a08d-4b77773fcccc-kube-api-access-8xf44\") pod \"payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:46.979509 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.979476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dbcafd2-623c-4a02-a08d-4b77773fcccc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:46.979509 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.979510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xf44\" (UniqueName: \"kubernetes.io/projected/8dbcafd2-623c-4a02-a08d-4b77773fcccc-kube-api-access-8xf44\") pod \"payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:46.980204 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.980181    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dbcafd2-623c-4a02-a08d-4b77773fcccc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:46.991654 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:46.991629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xf44\" (UniqueName: \"kubernetes.io/projected/8dbcafd2-623c-4a02-a08d-4b77773fcccc-kube-api-access-8xf44\") pod \"payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:47.122758 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:47.122722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:47.267847 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:47.267824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"]
Jul 27 21:37:47.269618 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:37:47.269578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbcafd2_623c_4a02_a08d_4b77773fcccc.slice/crio-a4207d0847d744689c8de52852aaecd983aafea2989eaac9eb69f66453e8b5f4 WatchSource:0}: Error finding container a4207d0847d744689c8de52852aaecd983aafea2989eaac9eb69f66453e8b5f4: Status 404 returned error can't find the container with id a4207d0847d744689c8de52852aaecd983aafea2989eaac9eb69f66453e8b5f4
Jul 27 21:37:47.758907 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:47.758874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8" event={"ID":"8dbcafd2-623c-4a02-a08d-4b77773fcccc","Type":"ContainerStarted","Data":"53e7beabfbd079012e8cabe2354676a9dcc20228a59f208b3fa58e37588c9ff8"}
Jul 27 21:37:47.759097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:47.758929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8" event={"ID":"8dbcafd2-623c-4a02-a08d-4b77773fcccc","Type":"ContainerStarted","Data":"a4207d0847d744689c8de52852aaecd983aafea2989eaac9eb69f66453e8b5f4"}
Jul 27 21:37:47.759097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:47.758949    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:47.774052 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:47.773998    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8" podStartSLOduration=1.773980981 podStartE2EDuration="1.773980981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:47.77230891 +0000 UTC m=+2413.932699271" watchObservedRunningTime="2026-07-27 21:37:47.773980981 +0000 UTC m=+2413.934371340"
Jul 27 21:37:50.442399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:50.442364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:50.799354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:50.799317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:50.985414 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:50.985381    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:37:51.111162 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.111085    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"]
Jul 27 21:37:51.114835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.114814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.117213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.117195    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c66b3c-openshift-default-dockercfg-r9r8n\""
Jul 27 21:37:51.125843 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.125818    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"]
Jul 27 21:37:51.137360 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.137326    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:51.218552 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-data\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218711 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx6xw\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-kube-api-access-wx6xw\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218711 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-certs\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-envoy\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61499707-658c-4e78-9165-c035411ce3df-istiod-ca-cert\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218835 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61499707-658c-4e78-9165-c035411ce3df-istio-podinfo\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218958 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-credential-socket\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218958 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-socket\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.218958 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.218932    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-istio-token\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.319936 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.319909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx6xw\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-kube-api-access-wx6xw\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.319956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-certs\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.319994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-envoy\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61499707-658c-4e78-9165-c035411ce3df-istiod-ca-cert\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61499707-658c-4e78-9165-c035411ce3df-istio-podinfo\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320268 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-credential-socket\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320268 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-socket\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320268 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-istio-token\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320268 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-data\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320519 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-certs\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320694 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-credential-socket\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320780 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-data\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320912 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61499707-658c-4e78-9165-c035411ce3df-istiod-ca-cert\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.320976 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.320904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-socket\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.322446 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.322429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-envoy\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.322957 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.322930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61499707-658c-4e78-9165-c035411ce3df-istio-podinfo\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.329801 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.329775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-istio-token\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.330308 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.330288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx6xw\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-kube-api-access-wx6xw\") pod \"e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") " pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.412244 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.412177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:51.426193 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.426171    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:51.570249 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.570223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"]
Jul 27 21:37:51.571943 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:37:51.571910    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61499707_658c_4e78_9165_c035411ce3df.slice/crio-586b6271b27ccb8d7feceb8fc5935edeab196d1548ed05f5a9eddb1cfd29b9d8 WatchSource:0}: Error finding container 586b6271b27ccb8d7feceb8fc5935edeab196d1548ed05f5a9eddb1cfd29b9d8: Status 404 returned error can't find the container with id 586b6271b27ccb8d7feceb8fc5935edeab196d1548ed05f5a9eddb1cfd29b9d8
Jul 27 21:37:51.574097 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.574081    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:37:51.781979 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:51.781942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" event={"ID":"61499707-658c-4e78-9165-c035411ce3df","Type":"ContainerStarted","Data":"586b6271b27ccb8d7feceb8fc5935edeab196d1548ed05f5a9eddb1cfd29b9d8"}
Jul 27 21:37:54.672389 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:54.671776    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:37:54.672389 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:54.671842    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:37:54.672389 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:54.671890    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:37:54.803282 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:54.803243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" event={"ID":"61499707-658c-4e78-9165-c035411ce3df","Type":"ContainerStarted","Data":"c8e4d4243fb585c5148dc83bd0e176c41832a76bc998571cc0592955b13bdd89"}
Jul 27 21:37:54.824138 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:54.824085    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" podStartSLOduration=0.726820355 podStartE2EDuration="3.824065003s" totalImagesPullingTime="3.097244648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:54.822446176 +0000 UTC m=+2420.982836528" watchObservedRunningTime="2026-07-27 21:37:54.824065003 +0000 UTC m=+2420.984455375"
Jul 27 21:37:55.426824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:55.426792    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:55.431373 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:55.431349    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:55.809355 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:55.809324    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:55.810266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:55.810247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:37:56.781549 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.781516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:56.883924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.883892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:56.889716 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.889689    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"]
Jul 27 21:37:56.893372 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.893347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:56.895917 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.895897    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 21:37:56.896047 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.895897    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:37:56.896662 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.896645    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gdtk\""
Jul 27 21:37:56.896756 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.896663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c66b3c-serving-cert\""
Jul 27 21:37:56.905484 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.905463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"]
Jul 27 21:37:56.981501 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:56.981472    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:57.072343 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.072278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.072343 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.072329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx6fn\" (UniqueName: \"kubernetes.io/projected/937061b3-9065-4996-b820-a0ac9238aefe-kube-api-access-cx6fn\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.072495 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.072445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/937061b3-9065-4996-b820-a0ac9238aefe-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.173512 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.173483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/937061b3-9065-4996-b820-a0ac9238aefe-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.173638 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.173542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.173638 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.173566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx6fn\" (UniqueName: \"kubernetes.io/projected/937061b3-9065-4996-b820-a0ac9238aefe-kube-api-access-cx6fn\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.173712 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:37:57.173690    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-serving-cert: secret "maas-api-e2e-inf-b-c66b3c-serving-cert" not found
Jul 27 21:37:57.173789 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:37:57.173776    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls podName:937061b3-9065-4996-b820-a0ac9238aefe nodeName:}" failed. No retries permitted until 2026-07-27 21:37:57.673753827 +0000 UTC m=+2423.834144175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls") pod "maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v" (UID: "937061b3-9065-4996-b820-a0ac9238aefe") : secret "maas-api-e2e-inf-b-c66b3c-serving-cert" not found
Jul 27 21:37:57.174169 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.174153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/937061b3-9065-4996-b820-a0ac9238aefe-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.185199 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.185172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx6fn\" (UniqueName: \"kubernetes.io/projected/937061b3-9065-4996-b820-a0ac9238aefe-kube-api-access-cx6fn\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.297890 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.297858    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:57.461468 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.461397    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:57.559401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.559377    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:37:57.678844 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.678813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.686840 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.686805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls\") pod \"maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.805101 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.805079    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:57.942867 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:57.942808    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"]
Jul 27 21:37:57.945012 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:37:57.944985    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937061b3_9065_4996_b820_a0ac9238aefe.slice/crio-d42ddb2ceeb38fa8d33942783d3182132c7b68a5c0ac1fb89cdc306bc8f7286a WatchSource:0}: Error finding container d42ddb2ceeb38fa8d33942783d3182132c7b68a5c0ac1fb89cdc306bc8f7286a: Status 404 returned error can't find the container with id d42ddb2ceeb38fa8d33942783d3182132c7b68a5c0ac1fb89cdc306bc8f7286a
Jul 27 21:37:58.766712 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:58.766639    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:37:58.827531 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:58.827496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v" event={"ID":"937061b3-9065-4996-b820-a0ac9238aefe","Type":"ContainerStarted","Data":"c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64"}
Jul 27 21:37:58.827726 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:58.827555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v" event={"ID":"937061b3-9065-4996-b820-a0ac9238aefe","Type":"ContainerStarted","Data":"d42ddb2ceeb38fa8d33942783d3182132c7b68a5c0ac1fb89cdc306bc8f7286a"}
Jul 27 21:37:58.827726 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:58.827625    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:37:58.844280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:37:58.844237    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v" podStartSLOduration=2.49626776 podStartE2EDuration="2.844224311s" totalImagesPullingTime="347.956551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:58.842302571 +0000 UTC m=+2425.002692931" watchObservedRunningTime="2026-07-27 21:37:58.844224311 +0000 UTC m=+2425.004614670"
Jul 27 21:38:00.550445 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:00.550416    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:38:01.342197 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:01.342162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:38:04.839228 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:04.839201    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:38:08.887134 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:08.887083    2579 generic.go:356] "Generic (PLEG): container finished" podID="61499707-658c-4e78-9165-c035411ce3df" containerID="c8e4d4243fb585c5148dc83bd0e176c41832a76bc998571cc0592955b13bdd89" exitCode=0
Jul 27 21:38:08.887134 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:08.887129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" event={"ID":"61499707-658c-4e78-9165-c035411ce3df","Type":"ContainerDied","Data":"c8e4d4243fb585c5148dc83bd0e176c41832a76bc998571cc0592955b13bdd89"}
Jul 27 21:38:08.887505 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:08.887469    2579 scope.go:117] "RemoveContainer" containerID="c8e4d4243fb585c5148dc83bd0e176c41832a76bc998571cc0592955b13bdd89"
Jul 27 21:38:08.888471 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:08.888441    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:38:08.888560 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:08.888511    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:38:08.888560 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:08.888539    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:38:09.898523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:09.898454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" event={"ID":"61499707-658c-4e78-9165-c035411ce3df","Type":"ContainerStarted","Data":"89bfc6a768342d36ddc41ebd96c751908d7d8c9bad5b11edaf3e5b617d71bf3f"}
Jul 27 21:38:10.426440 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:10.426397    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:38:10.427688 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:10.427659    2579 patch_prober.go:28] interesting pod/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:38:10.427811 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:10.427711    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 27 21:38:10.810060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:10.810023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:38:11.427379 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:11.427344    2579 patch_prober.go:28] interesting pod/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:38:11.427804 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:11.427395    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 27 21:38:12.426916 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:12.426883    2579 patch_prober.go:28] interesting pod/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:38:12.427092 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:12.426943    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 27 21:38:13.426943 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:13.426908    2579 patch_prober.go:28] interesting pod/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:38:13.427399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:13.426962    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 27 21:38:14.430937 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:14.430904    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:38:14.431912 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:14.431894    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:38:14.721540 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:14.721438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:38:17.946936 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:17.946901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:38:28.842042 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:28.842010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:38:34.672811 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:34.672774    2579 scope.go:117] "RemoveContainer" containerID="e448b97138af41b6c58f970000340ba81d7982f7345b3faa47d2eaacb65f4da6"
Jul 27 21:38:48.325182 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:48.325148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:38:52.541623 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:38:52.541554    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:39:31.441399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:31.441311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:32.625631 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.625579    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:32.797989 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.797942    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"]
Jul 27 21:39:32.800558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.800541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"
Jul 27 21:39:32.802861 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.802838    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:39:32.848170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.848134    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"]
Jul 27 21:39:32.882940 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.882819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3f80-52d0-48cc-8423-c69e0feae0cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk\" (UID: \"b6cc3f80-52d0-48cc-8423-c69e0feae0cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"
Jul 27 21:39:32.983894 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.983859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3f80-52d0-48cc-8423-c69e0feae0cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk\" (UID: \"b6cc3f80-52d0-48cc-8423-c69e0feae0cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"
Jul 27 21:39:32.984527 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:32.984508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3f80-52d0-48cc-8423-c69e0feae0cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk\" (UID: \"b6cc3f80-52d0-48cc-8423-c69e0feae0cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"
Jul 27 21:39:33.110256 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:33.110211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"
Jul 27 21:39:33.286196 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:33.286171    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"]
Jul 27 21:39:33.288233 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:39:33.288207    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cc3f80_52d0_48cc_8423_c69e0feae0cf.slice/crio-d0d2bba1268ea10de4e988f5ac6b934e74ea01d4cb324444bd425d54bce2d679 WatchSource:0}: Error finding container d0d2bba1268ea10de4e988f5ac6b934e74ea01d4cb324444bd425d54bce2d679: Status 404 returned error can't find the container with id d0d2bba1268ea10de4e988f5ac6b934e74ea01d4cb324444bd425d54bce2d679
Jul 27 21:39:33.401573 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:33.401541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk" event={"ID":"b6cc3f80-52d0-48cc-8423-c69e0feae0cf","Type":"ContainerStarted","Data":"d0d2bba1268ea10de4e988f5ac6b934e74ea01d4cb324444bd425d54bce2d679"}
Jul 27 21:39:34.408191 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:34.408163    2579 generic.go:356] "Generic (PLEG): container finished" podID="b6cc3f80-52d0-48cc-8423-c69e0feae0cf" containerID="962ae2e62cb349765b6c1ef23c3d89f1ef29b7f30f35472ca18031602d1c539b" exitCode=0
Jul 27 21:39:34.408585 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:34.408241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk" event={"ID":"b6cc3f80-52d0-48cc-8423-c69e0feae0cf","Type":"ContainerDied","Data":"962ae2e62cb349765b6c1ef23c3d89f1ef29b7f30f35472ca18031602d1c539b"}
Jul 27 21:39:35.541639 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:35.541594    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"
Jul 27 21:39:35.606672 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:35.606637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3f80-52d0-48cc-8423-c69e0feae0cf-maas-api-service-ca\") pod \"b6cc3f80-52d0-48cc-8423-c69e0feae0cf\" (UID: \"b6cc3f80-52d0-48cc-8423-c69e0feae0cf\") "
Jul 27 21:39:35.606966 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:35.606945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6cc3f80-52d0-48cc-8423-c69e0feae0cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b6cc3f80-52d0-48cc-8423-c69e0feae0cf" (UID: "b6cc3f80-52d0-48cc-8423-c69e0feae0cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:39:35.707626 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:35.707551    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3f80-52d0-48cc-8423-c69e0feae0cf-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:39:36.426655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:36.426625    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"
Jul 27 21:39:36.426817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:36.426622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk" event={"ID":"b6cc3f80-52d0-48cc-8423-c69e0feae0cf","Type":"ContainerDied","Data":"d0d2bba1268ea10de4e988f5ac6b934e74ea01d4cb324444bd425d54bce2d679"}
Jul 27 21:39:36.426817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:36.426763    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d2bba1268ea10de4e988f5ac6b934e74ea01d4cb324444bd425d54bce2d679"
Jul 27 21:39:37.744576 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:37.744540    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:39:43.223320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.223225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:43.241339 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.241298    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"]
Jul 27 21:39:43.241568 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.241525    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8" podUID="8dbcafd2-623c-4a02-a08d-4b77773fcccc" containerName="payload-processing" containerID="cri-o://53e7beabfbd079012e8cabe2354676a9dcc20228a59f208b3fa58e37588c9ff8" gracePeriod=30
Jul 27 21:39:43.324118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.324078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:43.383344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.383313    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"]
Jul 27 21:39:43.387133 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.387105    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-16c965-fm2dk"]
Jul 27 21:39:43.387911 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.387887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:43.468224 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.468189    2579 generic.go:356] "Generic (PLEG): container finished" podID="8dbcafd2-623c-4a02-a08d-4b77773fcccc" containerID="53e7beabfbd079012e8cabe2354676a9dcc20228a59f208b3fa58e37588c9ff8" exitCode=0
Jul 27 21:39:43.468359 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.468259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8" event={"ID":"8dbcafd2-623c-4a02-a08d-4b77773fcccc","Type":"ContainerDied","Data":"53e7beabfbd079012e8cabe2354676a9dcc20228a59f208b3fa58e37588c9ff8"}
Jul 27 21:39:43.502024 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.501996    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:39:43.674612 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.674581    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xf44\" (UniqueName: \"kubernetes.io/projected/8dbcafd2-623c-4a02-a08d-4b77773fcccc-kube-api-access-8xf44\") pod \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") "
Jul 27 21:39:43.674750 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.674698    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dbcafd2-623c-4a02-a08d-4b77773fcccc-plugins-config-volume\") pod \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\" (UID: \"8dbcafd2-623c-4a02-a08d-4b77773fcccc\") "
Jul 27 21:39:43.675058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.675033    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dbcafd2-623c-4a02-a08d-4b77773fcccc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8dbcafd2-623c-4a02-a08d-4b77773fcccc" (UID: "8dbcafd2-623c-4a02-a08d-4b77773fcccc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:39:43.676937 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.676916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbcafd2-623c-4a02-a08d-4b77773fcccc-kube-api-access-8xf44" (OuterVolumeSpecName: "kube-api-access-8xf44") pod "8dbcafd2-623c-4a02-a08d-4b77773fcccc" (UID: "8dbcafd2-623c-4a02-a08d-4b77773fcccc"). InnerVolumeSpecName "kube-api-access-8xf44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:43.770033 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.770007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:43.776080 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.776059    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dbcafd2-623c-4a02-a08d-4b77773fcccc-plugins-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:39:43.776147 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:43.776083    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xf44\" (UniqueName: \"kubernetes.io/projected/8dbcafd2-623c-4a02-a08d-4b77773fcccc-kube-api-access-8xf44\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:39:44.390753 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:44.390718    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6cc3f80-52d0-48cc-8423-c69e0feae0cf" path="/var/lib/kubelet/pods/b6cc3f80-52d0-48cc-8423-c69e0feae0cf/volumes"
Jul 27 21:39:44.475647 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:44.475620    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"
Jul 27 21:39:44.475775 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:44.475638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8" event={"ID":"8dbcafd2-623c-4a02-a08d-4b77773fcccc","Type":"ContainerDied","Data":"a4207d0847d744689c8de52852aaecd983aafea2989eaac9eb69f66453e8b5f4"}
Jul 27 21:39:44.475775 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:44.475710    2579 scope.go:117] "RemoveContainer" containerID="53e7beabfbd079012e8cabe2354676a9dcc20228a59f208b3fa58e37588c9ff8"
Jul 27 21:39:44.492140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:44.492119    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"]
Jul 27 21:39:44.494330 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:44.494311    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-16c965-f4487889d-vvcz8"]
Jul 27 21:39:46.390064 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:46.390033    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dbcafd2-623c-4a02-a08d-4b77773fcccc" path="/var/lib/kubelet/pods/8dbcafd2-623c-4a02-a08d-4b77773fcccc/volumes"
Jul 27 21:39:48.241658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:48.241627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:39:49.597217 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:49.597179    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:49.659650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:49.659576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:49.874635 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:49.874531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:50.129069 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.128988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:39:50.240280 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.240250    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"]
Jul 27 21:39:50.240669 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.240652    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6cc3f80-52d0-48cc-8423-c69e0feae0cf" containerName="revoke-keys"
Jul 27 21:39:50.240719 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.240670    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6cc3f80-52d0-48cc-8423-c69e0feae0cf" containerName="revoke-keys"
Jul 27 21:39:50.240719 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.240688    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbcafd2-623c-4a02-a08d-4b77773fcccc" containerName="payload-processing"
Jul 27 21:39:50.240719 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.240694    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbcafd2-623c-4a02-a08d-4b77773fcccc" containerName="payload-processing"
Jul 27 21:39:50.240822 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.240757    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbcafd2-623c-4a02-a08d-4b77773fcccc" containerName="payload-processing"
Jul 27 21:39:50.240822 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.240765    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6cc3f80-52d0-48cc-8423-c69e0feae0cf" containerName="revoke-keys"
Jul 27 21:39:50.243870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.243844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"
Jul 27 21:39:50.246508 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.246471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:39:50.248735 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.248704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"]
Jul 27 21:39:50.431161 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.431084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d676ab2-20fa-48ee-9320-42b84fd31455-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv\" (UID: \"0d676ab2-20fa-48ee-9320-42b84fd31455\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"
Jul 27 21:39:50.531888 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.531859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d676ab2-20fa-48ee-9320-42b84fd31455-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv\" (UID: \"0d676ab2-20fa-48ee-9320-42b84fd31455\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"
Jul 27 21:39:50.532473 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.532452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d676ab2-20fa-48ee-9320-42b84fd31455-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv\" (UID: \"0d676ab2-20fa-48ee-9320-42b84fd31455\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"
Jul 27 21:39:50.557891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.557869    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"
Jul 27 21:39:50.697041 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:50.697012    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"]
Jul 27 21:39:50.698005 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:39:50.697974    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d676ab2_20fa_48ee_9320_42b84fd31455.slice/crio-1ba64c71550e6afb395168480b20b4dd3f1f7b5c8c966769e23eea3b7b4b02d6 WatchSource:0}: Error finding container 1ba64c71550e6afb395168480b20b4dd3f1f7b5c8c966769e23eea3b7b4b02d6: Status 404 returned error can't find the container with id 1ba64c71550e6afb395168480b20b4dd3f1f7b5c8c966769e23eea3b7b4b02d6
Jul 27 21:39:51.518217 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:51.518184    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d676ab2-20fa-48ee-9320-42b84fd31455" containerID="03a5fb93faedf7988158181a5034b9ddc3d9bed486edd5faaa23ee640ec0f8dd" exitCode=0
Jul 27 21:39:51.518342 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:51.518268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv" event={"ID":"0d676ab2-20fa-48ee-9320-42b84fd31455","Type":"ContainerDied","Data":"03a5fb93faedf7988158181a5034b9ddc3d9bed486edd5faaa23ee640ec0f8dd"}
Jul 27 21:39:51.518342 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:51.518324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv" event={"ID":"0d676ab2-20fa-48ee-9320-42b84fd31455","Type":"ContainerStarted","Data":"1ba64c71550e6afb395168480b20b4dd3f1f7b5c8c966769e23eea3b7b4b02d6"}
Jul 27 21:39:52.654998 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:52.654976    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"
Jul 27 21:39:52.847977 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:52.847908    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d676ab2-20fa-48ee-9320-42b84fd31455-maas-api-service-ca\") pod \"0d676ab2-20fa-48ee-9320-42b84fd31455\" (UID: \"0d676ab2-20fa-48ee-9320-42b84fd31455\") "
Jul 27 21:39:52.848270 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:52.848245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d676ab2-20fa-48ee-9320-42b84fd31455-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d676ab2-20fa-48ee-9320-42b84fd31455" (UID: "0d676ab2-20fa-48ee-9320-42b84fd31455"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:39:52.949048 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:52.949021    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d676ab2-20fa-48ee-9320-42b84fd31455-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:39:53.530405 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:53.530377    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"
Jul 27 21:39:53.530544 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:53.530416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv" event={"ID":"0d676ab2-20fa-48ee-9320-42b84fd31455","Type":"ContainerDied","Data":"1ba64c71550e6afb395168480b20b4dd3f1f7b5c8c966769e23eea3b7b4b02d6"}
Jul 27 21:39:53.530544 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:39:53.530465    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ba64c71550e6afb395168480b20b4dd3f1f7b5c8c966769e23eea3b7b4b02d6"
Jul 27 21:40:00.830456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:00.830419    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"]
Jul 27 21:40:00.830972 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:00.830649    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v" podUID="937061b3-9065-4996-b820-a0ac9238aefe" containerName="maas-api" containerID="cri-o://c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64" gracePeriod=30
Jul 27 21:40:00.859532 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:00.859505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:00.959833 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:00.959798    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:01.023040 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.023005    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"]
Jul 27 21:40:01.030140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.030109    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c66b3c-pclhv"]
Jul 27 21:40:01.037860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.037827    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:01.294406 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.294382    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:40:01.313816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.313794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/937061b3-9065-4996-b820-a0ac9238aefe-openshift-service-ca\") pod \"937061b3-9065-4996-b820-a0ac9238aefe\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") "
Jul 27 21:40:01.313952 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.313835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls\") pod \"937061b3-9065-4996-b820-a0ac9238aefe\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") "
Jul 27 21:40:01.314019 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.313960    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx6fn\" (UniqueName: \"kubernetes.io/projected/937061b3-9065-4996-b820-a0ac9238aefe-kube-api-access-cx6fn\") pod \"937061b3-9065-4996-b820-a0ac9238aefe\" (UID: \"937061b3-9065-4996-b820-a0ac9238aefe\") "
Jul 27 21:40:01.314180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.314156    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/937061b3-9065-4996-b820-a0ac9238aefe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "937061b3-9065-4996-b820-a0ac9238aefe" (UID: "937061b3-9065-4996-b820-a0ac9238aefe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:01.314358 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.314334    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/937061b3-9065-4996-b820-a0ac9238aefe-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:01.316242 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.316215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "937061b3-9065-4996-b820-a0ac9238aefe" (UID: "937061b3-9065-4996-b820-a0ac9238aefe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:40:01.316324 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.316276    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937061b3-9065-4996-b820-a0ac9238aefe-kube-api-access-cx6fn" (OuterVolumeSpecName: "kube-api-access-cx6fn") pod "937061b3-9065-4996-b820-a0ac9238aefe" (UID: "937061b3-9065-4996-b820-a0ac9238aefe"). InnerVolumeSpecName "kube-api-access-cx6fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:01.408270 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.408207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:01.415434 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.415407    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/937061b3-9065-4996-b820-a0ac9238aefe-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:01.415522 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.415436    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx6fn\" (UniqueName: \"kubernetes.io/projected/937061b3-9065-4996-b820-a0ac9238aefe-kube-api-access-cx6fn\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:01.581909 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.581877    2579 generic.go:356] "Generic (PLEG): container finished" podID="937061b3-9065-4996-b820-a0ac9238aefe" containerID="c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64" exitCode=0
Jul 27 21:40:01.582119 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.581934    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"
Jul 27 21:40:01.582119 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.581962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v" event={"ID":"937061b3-9065-4996-b820-a0ac9238aefe","Type":"ContainerDied","Data":"c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64"}
Jul 27 21:40:01.582119 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.582037    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v" event={"ID":"937061b3-9065-4996-b820-a0ac9238aefe","Type":"ContainerDied","Data":"d42ddb2ceeb38fa8d33942783d3182132c7b68a5c0ac1fb89cdc306bc8f7286a"}
Jul 27 21:40:01.582119 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.582060    2579 scope.go:117] "RemoveContainer" containerID="c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64"
Jul 27 21:40:01.591594 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.591574    2579 scope.go:117] "RemoveContainer" containerID="c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64"
Jul 27 21:40:01.591880 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:40:01.591860    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64\": container with ID starting with c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64 not found: ID does not exist" containerID="c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64"
Jul 27 21:40:01.591950 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.591887    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64"} err="failed to get container status \"c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64\": rpc error: code = NotFound desc = could not find container \"c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64\": container with ID starting with c24833e49c69dc58ab2dfbe41dfc61307e344b9b8af5dba4dfe94206b54e2c64 not found: ID does not exist"
Jul 27 21:40:01.603585 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.603559    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"]
Jul 27 21:40:01.608191 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:01.608172    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c66b3c-54b6d8fc9-gdn9v"]
Jul 27 21:40:02.389071 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:02.389044    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d676ab2-20fa-48ee-9320-42b84fd31455" path="/var/lib/kubelet/pods/0d676ab2-20fa-48ee-9320-42b84fd31455/volumes"
Jul 27 21:40:02.389428 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:02.389402    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="937061b3-9065-4996-b820-a0ac9238aefe" path="/var/lib/kubelet/pods/937061b3-9065-4996-b820-a0ac9238aefe/volumes"
Jul 27 21:40:03.739922 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:03.739893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:40:05.914320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:05.914284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:07.226174 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:07.226129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:07.327353 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:07.327321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:07.470671 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:07.470642    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"]
Jul 27 21:40:07.470894 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:07.470872    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy" containerID="cri-o://89bfc6a768342d36ddc41ebd96c751908d7d8c9bad5b11edaf3e5b617d71bf3f" gracePeriod=30
Jul 27 21:40:07.530339 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:07.530314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:07.726514 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:07.726485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:08.099698 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.099661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:08.391977 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.391905    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"]
Jul 27 21:40:08.392463 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.392443    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="937061b3-9065-4996-b820-a0ac9238aefe" containerName="maas-api"
Jul 27 21:40:08.392523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.392467    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="937061b3-9065-4996-b820-a0ac9238aefe" containerName="maas-api"
Jul 27 21:40:08.392523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.392479    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d676ab2-20fa-48ee-9320-42b84fd31455" containerName="revoke-keys"
Jul 27 21:40:08.392523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.392487    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d676ab2-20fa-48ee-9320-42b84fd31455" containerName="revoke-keys"
Jul 27 21:40:08.392658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.392570    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d676ab2-20fa-48ee-9320-42b84fd31455" containerName="revoke-keys"
Jul 27 21:40:08.392658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.392587    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="937061b3-9065-4996-b820-a0ac9238aefe" containerName="maas-api"
Jul 27 21:40:08.395475 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.395458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.398163 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.398142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-aba24e-openshift-default-dockercfg-hnmn2\""
Jul 27 21:40:08.401082 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.401058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"]
Jul 27 21:40:08.409357 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.409333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:08.463634 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istiod-ca-cert\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.463800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd6l7\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-kube-api-access-pd6l7\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.463800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-credential-socket\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.463800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-token\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.463907 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-certs\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.463907 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-podinfo\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.463907 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-socket\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.464002 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-data\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.464002 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.463925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-envoy\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565073 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-certs\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-podinfo\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-socket\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-data\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-envoy\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istiod-ca-cert\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6l7\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-kube-api-access-pd6l7\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-credential-socket\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-token\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-certs\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565551 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-data\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565796 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-socket\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.565855 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.565818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-credential-socket\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.566072 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.566000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istiod-ca-cert\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.567752 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.567724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-envoy\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.568004 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.567983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-podinfo\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.572954 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.572933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-token\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.573137 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.573120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd6l7\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-kube-api-access-pd6l7\") pod \"e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") " pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.708002 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.707944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:08.767120 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.766897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:08.846828 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.846797    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"]
Jul 27 21:40:08.848025 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:40:08.847988    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e17d1c_93a8_405c_84ef_fc8f9489fb73.slice/crio-d3b78fa247e98f24aac34a1ca8d2801218c8b62eb87da118c20b5024a9ac21d1 WatchSource:0}: Error finding container d3b78fa247e98f24aac34a1ca8d2801218c8b62eb87da118c20b5024a9ac21d1: Status 404 returned error can't find the container with id d3b78fa247e98f24aac34a1ca8d2801218c8b62eb87da118c20b5024a9ac21d1
Jul 27 21:40:08.850347 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.850316    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:08.850436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.850379    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:08.850436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:08.850406    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:09.629345 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:09.629300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" event={"ID":"c6e17d1c-93a8-405c-84ef-fc8f9489fb73","Type":"ContainerStarted","Data":"d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a"}
Jul 27 21:40:09.629710 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:09.629369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" event={"ID":"c6e17d1c-93a8-405c-84ef-fc8f9489fb73","Type":"ContainerStarted","Data":"d3b78fa247e98f24aac34a1ca8d2801218c8b62eb87da118c20b5024a9ac21d1"}
Jul 27 21:40:09.647244 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:09.647196    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" podStartSLOduration=1.647177622 podStartE2EDuration="1.647177622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:09.646521693 +0000 UTC m=+2555.806912063" watchObservedRunningTime="2026-07-27 21:40:09.647177622 +0000 UTC m=+2555.807567984"
Jul 27 21:40:09.708225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:09.708202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:09.713141 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:09.713119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:10.634584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:10.634553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:10.635418 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:10.635403    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:11.574914 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:11.574873    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:11.664082 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:11.664049    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:11.732120 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:11.732076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:12.040112 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.040081    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:12.281253 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.281217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:12.351804 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.351721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:12.651905 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.651872    2579 generic.go:356] "Generic (PLEG): container finished" podID="61499707-658c-4e78-9165-c035411ce3df" containerID="89bfc6a768342d36ddc41ebd96c751908d7d8c9bad5b11edaf3e5b617d71bf3f" exitCode=0
Jul 27 21:40:12.652065 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.651921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" event={"ID":"61499707-658c-4e78-9165-c035411ce3df","Type":"ContainerDied","Data":"89bfc6a768342d36ddc41ebd96c751908d7d8c9bad5b11edaf3e5b617d71bf3f"}
Jul 27 21:40:12.652065 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.651989    2579 scope.go:117] "RemoveContainer" containerID="c8e4d4243fb585c5148dc83bd0e176c41832a76bc998571cc0592955b13bdd89"
Jul 27 21:40:12.734340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.734312    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:40:12.805509 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805474    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61499707-658c-4e78-9165-c035411ce3df-istiod-ca-cert\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805538    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-data\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805560    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61499707-658c-4e78-9165-c035411ce3df-istio-podinfo\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805589    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-socket\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805631    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-istio-token\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805683    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx6xw\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-kube-api-access-wx6xw\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805711    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-envoy\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805738    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-certs\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805786    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-credential-socket\") pod \"61499707-658c-4e78-9165-c035411ce3df\" (UID: \"61499707-658c-4e78-9165-c035411ce3df\") "
Jul 27 21:40:12.805881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.805869    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:40:12.806162 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.806082    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:40:12.806162 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.806110    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61499707-658c-4e78-9165-c035411ce3df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:12.806162 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.806146    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.806386 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.806307    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:40:12.806647 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.806585    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-data" (OuterVolumeSpecName: "istio-data") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:40:12.808018 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.807984    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61499707-658c-4e78-9165-c035411ce3df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:40:12.808105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.808042    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-kube-api-access-wx6xw" (OuterVolumeSpecName: "kube-api-access-wx6xw") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "kube-api-access-wx6xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:12.808105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.808071    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-istio-token" (OuterVolumeSpecName: "istio-token") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:12.808105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.808093    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61499707-658c-4e78-9165-c035411ce3df" (UID: "61499707-658c-4e78-9165-c035411ce3df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:40:12.907474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907396    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61499707-658c-4e78-9165-c035411ce3df-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.907474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907423    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.907474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907435    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61499707-658c-4e78-9165-c035411ce3df-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.907474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907445    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.907474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907457    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx6xw\" (UniqueName: \"kubernetes.io/projected/61499707-658c-4e78-9165-c035411ce3df-kube-api-access-wx6xw\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.907474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907471    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.907778 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907483    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.907778 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:12.907494    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61499707-658c-4e78-9165-c035411ce3df-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:13.660269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:13.660240    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"
Jul 27 21:40:13.660456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:13.660245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx" event={"ID":"61499707-658c-4e78-9165-c035411ce3df","Type":"ContainerDied","Data":"586b6271b27ccb8d7feceb8fc5935edeab196d1548ed05f5a9eddb1cfd29b9d8"}
Jul 27 21:40:13.660456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:13.660407    2579 scope.go:117] "RemoveContainer" containerID="89bfc6a768342d36ddc41ebd96c751908d7d8c9bad5b11edaf3e5b617d71bf3f"
Jul 27 21:40:13.683669 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:13.683643    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"]
Jul 27 21:40:13.685783 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:13.685767    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c66b3c-openshift-default-7f584d5bf4-7s7kx"]
Jul 27 21:40:14.391118 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:14.391086    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61499707-658c-4e78-9165-c035411ce3df" path="/var/lib/kubelet/pods/61499707-658c-4e78-9165-c035411ce3df/volumes"
Jul 27 21:40:16.088017 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.087980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:16.582479 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.582444    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:16.856240 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.856161    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"]
Jul 27 21:40:16.856529 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.856516    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy"
Jul 27 21:40:16.856566 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.856531    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy"
Jul 27 21:40:16.856566 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.856541    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy"
Jul 27 21:40:16.856566 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.856547    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy"
Jul 27 21:40:16.856699 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.856639    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy"
Jul 27 21:40:16.856699 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.856651    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61499707-658c-4e78-9165-c035411ce3df" containerName="istio-proxy"
Jul 27 21:40:16.861273 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.861249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.863580 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.863560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-740aee-openshift-default-dockercfg-2tbq7\""
Jul 27 21:40:16.871516 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.871493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"]
Jul 27 21:40:16.890272 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.890249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:16.947002 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.946974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-certs\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947082 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28b12b61-5e64-4b57-b723-a3b34120bb2d-istiod-ca-cert\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947082 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-credential-socket\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947168 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-podinfo\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947168 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-data\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947233 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-envoy\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947233 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-token\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947297 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-socket\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:16.947297 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:16.947262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hltz7\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-kube-api-access-hltz7\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.047939 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.047904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-socket\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.047939 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.047942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hltz7\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-kube-api-access-hltz7\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048159 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-certs\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048159 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28b12b61-5e64-4b57-b723-a3b34120bb2d-istiod-ca-cert\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048159 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-credential-socket\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-podinfo\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-data\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-envoy\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-token\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-socket\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-certs\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-credential-socket\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048666 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-data\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.048793 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.048775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28b12b61-5e64-4b57-b723-a3b34120bb2d-istiod-ca-cert\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.050748 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.050725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-envoy\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.051029 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.051009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-podinfo\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.060356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.060331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-token\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.060499 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.060377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hltz7\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-kube-api-access-hltz7\") pod \"e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") " pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.174497 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.174443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:17.175655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.175628    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:17.315259 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.315231    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"]
Jul 27 21:40:17.317391 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:40:17.317363    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b12b61_5e64_4b57_b723_a3b34120bb2d.slice/crio-898fa68ed9643b73fe997a3171b37f691c6d8790823bf616afb94d7d67d8f502 WatchSource:0}: Error finding container 898fa68ed9643b73fe997a3171b37f691c6d8790823bf616afb94d7d67d8f502: Status 404 returned error can't find the container with id 898fa68ed9643b73fe997a3171b37f691c6d8790823bf616afb94d7d67d8f502
Jul 27 21:40:17.319461 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.319425    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:17.319527 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.319487    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:17.319527 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.319514    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:17.588408 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.588376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:17.686201 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.686168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" event={"ID":"28b12b61-5e64-4b57-b723-a3b34120bb2d","Type":"ContainerStarted","Data":"dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833"}
Jul 27 21:40:17.686352 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.686251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" event={"ID":"28b12b61-5e64-4b57-b723-a3b34120bb2d","Type":"ContainerStarted","Data":"898fa68ed9643b73fe997a3171b37f691c6d8790823bf616afb94d7d67d8f502"}
Jul 27 21:40:17.688466 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.688441    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:17.706948 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:17.706903    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" podStartSLOduration=1.70688993 podStartE2EDuration="1.70688993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:17.703929268 +0000 UTC m=+2563.864319641" watchObservedRunningTime="2026-07-27 21:40:17.70688993 +0000 UTC m=+2563.867280289"
Jul 27 21:40:18.175260 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:18.175228    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:18.180149 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:18.180127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:18.692061 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:18.692033    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:18.693029 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:18.693010    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:19.547424 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:19.547385    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:40:19.658799 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:19.658766    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:19.744286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:19.744253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:19.828536 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:19.828449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:20.080107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:20.080021    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:20.468311 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:20.468242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:20.570051 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:20.570019    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:24.212382 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:24.212344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:25.654750 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:25.654707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:26.675741 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:26.675704    2579 patch_prober.go:28] interesting pod/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 21:40:26.676145 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:26.675785    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 21:40:28.757687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:28.757655    2579 generic.go:356] "Generic (PLEG): container finished" podID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerID="d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a" exitCode=0
Jul 27 21:40:28.758178 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:28.757697    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" event={"ID":"c6e17d1c-93a8-405c-84ef-fc8f9489fb73","Type":"ContainerDied","Data":"d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a"}
Jul 27 21:40:28.758178 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:28.758046    2579 scope.go:117] "RemoveContainer" containerID="d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a"
Jul 27 21:40:28.759073 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:28.759048    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:28.759138 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:28.759127    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:28.759176 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:28.759167    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:29.765069 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:29.765037    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" event={"ID":"c6e17d1c-93a8-405c-84ef-fc8f9489fb73","Type":"ContainerStarted","Data":"cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221"}
Jul 27 21:40:30.709079 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:30.709029    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:30.709296 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:30.709222    2579 patch_prober.go:28] interesting pod/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 21:40:30.709296 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:30.709282    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 21:40:31.709507 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:31.709031    2579 patch_prober.go:28] interesting pod/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 21:40:31.709507 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:31.709110    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 21:40:32.708372 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:32.708328    2579 patch_prober.go:28] interesting pod/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 21:40:32.708568 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:32.708399    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 21:40:33.709746 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:33.709273    2579 patch_prober.go:28] interesting pod/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 21:40:33.709746 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:33.709348    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 21:40:34.705954 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:34.705925    2579 scope.go:117] "RemoveContainer" containerID="40a80094effcf08e0e0ad19cd92a6f8977a798bc3134a41009f551c92fe22688"
Jul 27 21:40:34.715324 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:34.713991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:34.715324 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:34.715173    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:34.716812 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:34.716785    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:40:34.733746 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:34.733717    2579 patch_prober.go:28] interesting pod/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 21:40:34.733857 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:34.733778    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 21:40:35.048181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:35.048147    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:40:35.803044 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:35.803013    2579 generic.go:356] "Generic (PLEG): container finished" podID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerID="dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833" exitCode=0
Jul 27 21:40:35.803432 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:35.803089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" event={"ID":"28b12b61-5e64-4b57-b723-a3b34120bb2d","Type":"ContainerDied","Data":"dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833"}
Jul 27 21:40:35.803628 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:35.803583    2579 scope.go:117] "RemoveContainer" containerID="dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833"
Jul 27 21:40:35.804678 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:35.804652    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:35.804749 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:35.804717    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:35.804790 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:35.804751    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:40:36.814336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:36.814292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" event={"ID":"28b12b61-5e64-4b57-b723-a3b34120bb2d","Type":"ContainerStarted","Data":"ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b"}
Jul 27 21:40:37.174896 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:37.174804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:37.175076 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:37.175009    2579 patch_prober.go:28] interesting pod/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 21:40:37.175150 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:37.175070    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 21:40:38.175472 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:38.175432    2579 patch_prober.go:28] interesting pod/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 21:40:38.175974 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:38.175507    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 21:40:39.175072 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:39.175032    2579 patch_prober.go:28] interesting pod/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 21:40:39.175320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:39.175090    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 21:40:40.175438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:40.175406    2579 patch_prober.go:28] interesting pod/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 21:40:40.175869 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:40.175458    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 21:40:40.625064 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:40.625023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:41.179089 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:41.179056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:41.179550 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:41.179334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:41.180164 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:41.180148    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:40:48.302156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:48.302111    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:48.372154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:48.372122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:48.430402 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:48.430368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:48.491388 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:48.491352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:48.884512 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:48.884468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:51.648518 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:51.648482    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:40:54.821315 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:54.821222    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:54.906418 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:54.906379    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:55.193877 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.193799    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"]
Jul 27 21:40:55.194021 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.193997    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy" containerID="cri-o://cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221" gracePeriod=30
Jul 27 21:40:55.249398 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.249370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:55.423765 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.423733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:40:55.565016 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.564979    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"]
Jul 27 21:40:55.570157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.570121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"
Jul 27 21:40:55.572786 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.572517    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:40:55.572982 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.572946    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:40:55.573899 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.573880    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"]
Jul 27 21:40:55.606722 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.606689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd25c1-2f21-4986-a627-35d75beb53c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-740aee-q698s\" (UID: \"4ddd25c1-2f21-4986-a627-35d75beb53c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"
Jul 27 21:40:55.707496 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.707460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd25c1-2f21-4986-a627-35d75beb53c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-740aee-q698s\" (UID: \"4ddd25c1-2f21-4986-a627-35d75beb53c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"
Jul 27 21:40:55.708074 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.708056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd25c1-2f21-4986-a627-35d75beb53c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-740aee-q698s\" (UID: \"4ddd25c1-2f21-4986-a627-35d75beb53c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"
Jul 27 21:40:55.882854 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:55.882771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"
Jul 27 21:40:56.029917 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:56.029885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"]
Jul 27 21:40:56.030097 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:40:56.030076    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddd25c1_2f21_4986_a627_35d75beb53c7.slice/crio-54099133e0a9f10b70cabe71106db9aac0335e1e65a86e6d5201a45f659f5a4e WatchSource:0}: Error finding container 54099133e0a9f10b70cabe71106db9aac0335e1e65a86e6d5201a45f659f5a4e: Status 404 returned error can't find the container with id 54099133e0a9f10b70cabe71106db9aac0335e1e65a86e6d5201a45f659f5a4e
Jul 27 21:40:56.940740 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:56.940711    2579 generic.go:356] "Generic (PLEG): container finished" podID="4ddd25c1-2f21-4986-a627-35d75beb53c7" containerID="78cb4048345e5088a6203ac0f1c1f8e7da04b737becca161da8c87d1c37d9651" exitCode=0
Jul 27 21:40:56.941084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:56.940751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s" event={"ID":"4ddd25c1-2f21-4986-a627-35d75beb53c7","Type":"ContainerDied","Data":"78cb4048345e5088a6203ac0f1c1f8e7da04b737becca161da8c87d1c37d9651"}
Jul 27 21:40:56.941084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:56.940788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s" event={"ID":"4ddd25c1-2f21-4986-a627-35d75beb53c7","Type":"ContainerStarted","Data":"54099133e0a9f10b70cabe71106db9aac0335e1e65a86e6d5201a45f659f5a4e"}
Jul 27 21:40:58.083850 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:58.083825    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"
Jul 27 21:40:58.125819 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:58.125792    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd25c1-2f21-4986-a627-35d75beb53c7-maas-api-service-ca\") pod \"4ddd25c1-2f21-4986-a627-35d75beb53c7\" (UID: \"4ddd25c1-2f21-4986-a627-35d75beb53c7\") "
Jul 27 21:40:58.126224 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:58.126194    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ddd25c1-2f21-4986-a627-35d75beb53c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ddd25c1-2f21-4986-a627-35d75beb53c7" (UID: "4ddd25c1-2f21-4986-a627-35d75beb53c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:58.227285 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:58.227226    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd25c1-2f21-4986-a627-35d75beb53c7-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:40:58.954431 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:58.954399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s" event={"ID":"4ddd25c1-2f21-4986-a627-35d75beb53c7","Type":"ContainerDied","Data":"54099133e0a9f10b70cabe71106db9aac0335e1e65a86e6d5201a45f659f5a4e"}
Jul 27 21:40:58.954584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:58.954447    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54099133e0a9f10b70cabe71106db9aac0335e1e65a86e6d5201a45f659f5a4e"
Jul 27 21:40:58.954584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:40:58.954412    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"
Jul 27 21:41:00.444946 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.444923    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:41:00.543998 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.543975    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istiod-ca-cert\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544010    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-data\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544033    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-credential-socket\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544069    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-envoy\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544107 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd6l7\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-kube-api-access-pd6l7\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544279 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544156    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-podinfo\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544279 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544182    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-socket\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544279 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544218    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-token\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544279 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544244    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-certs\") pod \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\" (UID: \"c6e17d1c-93a8-405c-84ef-fc8f9489fb73\") "
Jul 27 21:41:00.544485 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544394    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:41:00.544707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544643    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:00.544707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544658    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:00.544872 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544739    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:00.545160 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.544995    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.545160 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.545099    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.545429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.545193    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.545429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.545206    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.545429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.545213    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:00.546570 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.546546    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:41:00.546681 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.546638    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:00.546724 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.546695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-kube-api-access-pd6l7" (OuterVolumeSpecName: "kube-api-access-pd6l7") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "kube-api-access-pd6l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:00.546724 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.546696    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6e17d1c-93a8-405c-84ef-fc8f9489fb73" (UID: "c6e17d1c-93a8-405c-84ef-fc8f9489fb73"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:00.646023 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.645999    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.646023 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.646022    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.646154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.646031    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.646154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.646038    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.646154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.646046    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd6l7\" (UniqueName: \"kubernetes.io/projected/c6e17d1c-93a8-405c-84ef-fc8f9489fb73-kube-api-access-pd6l7\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:00.972637 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.972561    2579 generic.go:356] "Generic (PLEG): container finished" podID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerID="cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221" exitCode=0
Jul 27 21:41:00.972734 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.972648    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"
Jul 27 21:41:00.972734 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.972653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" event={"ID":"c6e17d1c-93a8-405c-84ef-fc8f9489fb73","Type":"ContainerDied","Data":"cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221"}
Jul 27 21:41:00.972806 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.972739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc" event={"ID":"c6e17d1c-93a8-405c-84ef-fc8f9489fb73","Type":"ContainerDied","Data":"d3b78fa247e98f24aac34a1ca8d2801218c8b62eb87da118c20b5024a9ac21d1"}
Jul 27 21:41:00.972806 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.972771    2579 scope.go:117] "RemoveContainer" containerID="cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221"
Jul 27 21:41:00.983017 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.982998    2579 scope.go:117] "RemoveContainer" containerID="d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a"
Jul 27 21:41:00.991759 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.991740    2579 scope.go:117] "RemoveContainer" containerID="cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221"
Jul 27 21:41:00.992181 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:41:00.992156    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221\": container with ID starting with cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221 not found: ID does not exist" containerID="cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221"
Jul 27 21:41:00.992181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.992192    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221"} err="failed to get container status \"cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221\": rpc error: code = NotFound desc = could not find container \"cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221\": container with ID starting with cbe85f0d83e6fb2706fcbb040b95b31e6a3b04ddc8f255f56aaa2285ce14b221 not found: ID does not exist"
Jul 27 21:41:00.992367 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.992216    2579 scope.go:117] "RemoveContainer" containerID="d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a"
Jul 27 21:41:00.992494 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:41:00.992477    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a\": container with ID starting with d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a not found: ID does not exist" containerID="d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a"
Jul 27 21:41:00.992544 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.992500    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a"} err="failed to get container status \"d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a\": rpc error: code = NotFound desc = could not find container \"d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a\": container with ID starting with d7987ba86a32d2e6f62971225961468ffee7221bc1dc9f42e5ddcca32a88ad0a not found: ID does not exist"
Jul 27 21:41:00.994165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:00.994136    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"]
Jul 27 21:41:01.000375 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:01.000355    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-aba24e-openshift-default-5c5648bc86-76twc"]
Jul 27 21:41:02.389710 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:02.389681    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" path="/var/lib/kubelet/pods/c6e17d1c-93a8-405c-84ef-fc8f9489fb73/volumes"
Jul 27 21:41:11.144226 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:11.144188    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:11.210199 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:11.210165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:11.310825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:11.310791    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:11.311996 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:11.311967    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"]
Jul 27 21:41:11.314208 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:11.314185    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-740aee-q698s"]
Jul 27 21:41:11.411621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:11.411480    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:11.711141 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:11.711051    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:12.390842 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:12.390809    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ddd25c1-2f21-4986-a627-35d75beb53c7" path="/var/lib/kubelet/pods/4ddd25c1-2f21-4986-a627-35d75beb53c7/volumes"
Jul 27 21:41:15.349299 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:15.349262    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:41:17.457887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:17.457844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:17.561549 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:17.561511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:17.727130 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:17.727043    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"]
Jul 27 21:41:17.727326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:17.727299    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy" containerID="cri-o://ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b" gracePeriod=30
Jul 27 21:41:17.751967 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:17.751938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:17.978771 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:17.978680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:18.351974 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.351936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:18.646948 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.646863    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"]
Jul 27 21:41:18.647461 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647438    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy"
Jul 27 21:41:18.647589 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647466    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy"
Jul 27 21:41:18.647589 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647486    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy"
Jul 27 21:41:18.647589 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy"
Jul 27 21:41:18.647589 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647514    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ddd25c1-2f21-4986-a627-35d75beb53c7" containerName="revoke-keys"
Jul 27 21:41:18.647589 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647523    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ddd25c1-2f21-4986-a627-35d75beb53c7" containerName="revoke-keys"
Jul 27 21:41:18.647893 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647654    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ddd25c1-2f21-4986-a627-35d75beb53c7" containerName="revoke-keys"
Jul 27 21:41:18.647893 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647668    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy"
Jul 27 21:41:18.647893 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.647678    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e17d1c-93a8-405c-84ef-fc8f9489fb73" containerName="istio-proxy"
Jul 27 21:41:18.651411 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.651387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.653803 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.653779    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3298cd-openshift-default-dockercfg-6w42v\""
Jul 27 21:41:18.661995 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.661973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"]
Jul 27 21:41:18.676593 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.676567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:18.690353 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-data\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee115319-e150-4c54-8019-d40b59cb3a3c-istiod-ca-cert\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-podinfo\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-token\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690562 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-socket\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690562 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-credential-socket\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690641 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-envoy\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690641 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwndg\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-kube-api-access-jwndg\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.690711 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.690659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-certs\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.775817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.775787    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:18.791628 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-certs\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.791745 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-data\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.791814 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee115319-e150-4c54-8019-d40b59cb3a3c-istiod-ca-cert\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.791814 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-podinfo\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.791924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-token\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.791924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-socket\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.791924 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-credential-socket\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.792086 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-certs\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.792086 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.791965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-envoy\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.792086 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.792008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwndg\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-kube-api-access-jwndg\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.792276 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.792231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-data\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.792419 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.792395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-credential-socket\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.792500 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.792461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-socket\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.792692 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.792671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee115319-e150-4c54-8019-d40b59cb3a3c-istiod-ca-cert\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.794319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.794302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-envoy\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.794593 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.794577    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-podinfo\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.799659 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.799624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-token\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.799751 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.799672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwndg\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-kube-api-access-jwndg\") pod \"e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") " pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:18.964812 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:18.964738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:19.103155 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:19.103125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"]
Jul 27 21:41:19.104350 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:41:19.104322    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee115319_e150_4c54_8019_d40b59cb3a3c.slice/crio-7a7f4a998d6fc571174f3102e0545bab178dc7ac8eb6df3c9440b662fc6b06c7 WatchSource:0}: Error finding container 7a7f4a998d6fc571174f3102e0545bab178dc7ac8eb6df3c9440b662fc6b06c7: Status 404 returned error can't find the container with id 7a7f4a998d6fc571174f3102e0545bab178dc7ac8eb6df3c9440b662fc6b06c7
Jul 27 21:41:19.106426 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:19.106390    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:19.106494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:19.106460    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:19.106494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:19.106488    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:20.082515 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:20.082477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" event={"ID":"ee115319-e150-4c54-8019-d40b59cb3a3c","Type":"ContainerStarted","Data":"d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc"}
Jul 27 21:41:20.082913 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:20.082565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" event={"ID":"ee115319-e150-4c54-8019-d40b59cb3a3c","Type":"ContainerStarted","Data":"7a7f4a998d6fc571174f3102e0545bab178dc7ac8eb6df3c9440b662fc6b06c7"}
Jul 27 21:41:20.104136 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:20.104080    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" podStartSLOduration=2.104065799 podStartE2EDuration="2.104065799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:20.102811606 +0000 UTC m=+2626.263201978" watchObservedRunningTime="2026-07-27 21:41:20.104065799 +0000 UTC m=+2626.264456158"
Jul 27 21:41:20.965927 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:20.965889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:20.971331 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:20.971304    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:21.089138 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:21.089112    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:21.090000 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:21.089982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:22.048382 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:22.048343    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:22.135271 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:22.135225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:22.199659 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:22.199590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:22.543023 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:22.542981    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:22.644530 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:22.644478    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:22.777296 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:22.777271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:22.988067 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:22.988043    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:41:23.028506 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028483    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-certs\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-credential-socket\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028547    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-socket\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028628    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-envoy\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028648    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-podinfo\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028690    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hltz7\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-kube-api-access-hltz7\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028715    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28b12b61-5e64-4b57-b723-a3b34120bb2d-istiod-ca-cert\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028743    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-token\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.028986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028817    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:23.028986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028839    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:23.028986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028858    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:23.028986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.028869    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-data\") pod \"28b12b61-5e64-4b57-b723-a3b34120bb2d\" (UID: \"28b12b61-5e64-4b57-b723-a3b34120bb2d\") "
Jul 27 21:41:23.029286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.029173    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b12b61-5e64-4b57-b723-a3b34120bb2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:41:23.029286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.029258    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.029286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.029278    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.029392 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.029293    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.029392 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.029309    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28b12b61-5e64-4b57-b723-a3b34120bb2d-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.029937 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.029911    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:23.030958 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.030929    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:23.031050 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.030977    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:41:23.031475 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.031450    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:23.031475 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.031455    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-kube-api-access-hltz7" (OuterVolumeSpecName: "kube-api-access-hltz7") pod "28b12b61-5e64-4b57-b723-a3b34120bb2d" (UID: "28b12b61-5e64-4b57-b723-a3b34120bb2d"). InnerVolumeSpecName "kube-api-access-hltz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:23.103029 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.102968    2579 generic.go:356] "Generic (PLEG): container finished" podID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerID="ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b" exitCode=0
Jul 27 21:41:23.103129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.103027    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"
Jul 27 21:41:23.103129 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.103022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" event={"ID":"28b12b61-5e64-4b57-b723-a3b34120bb2d","Type":"ContainerDied","Data":"ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b"}
Jul 27 21:41:23.103241 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.103154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg" event={"ID":"28b12b61-5e64-4b57-b723-a3b34120bb2d","Type":"ContainerDied","Data":"898fa68ed9643b73fe997a3171b37f691c6d8790823bf616afb94d7d67d8f502"}
Jul 27 21:41:23.103241 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.103190    2579 scope.go:117] "RemoveContainer" containerID="ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b"
Jul 27 21:41:23.113789 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.113772    2579 scope.go:117] "RemoveContainer" containerID="dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833"
Jul 27 21:41:23.122049 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.121993    2579 scope.go:117] "RemoveContainer" containerID="ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b"
Jul 27 21:41:23.122455 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:41:23.122314    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b\": container with ID starting with ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b not found: ID does not exist" containerID="ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b"
Jul 27 21:41:23.122455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.122349    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b"} err="failed to get container status \"ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b\": rpc error: code = NotFound desc = could not find container \"ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b\": container with ID starting with ffbe8f55947933be2bde7292e8d32630c43a951f3228c7538d34b18269cb367b not found: ID does not exist"
Jul 27 21:41:23.122455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.122375    2579 scope.go:117] "RemoveContainer" containerID="dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833"
Jul 27 21:41:23.122830 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:41:23.122801    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833\": container with ID starting with dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833 not found: ID does not exist" containerID="dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833"
Jul 27 21:41:23.122939 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.122837    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833"} err="failed to get container status \"dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833\": rpc error: code = NotFound desc = could not find container \"dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833\": container with ID starting with dc773d126a2f02d74d05a0319478f8adc7ae70861c31c747606f679025e6d833 not found: ID does not exist"
Jul 27 21:41:23.125205 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.125181    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"]
Jul 27 21:41:23.129744 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.129723    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-740aee-openshift-default-7d754f9c86-m2mjg"]
Jul 27 21:41:23.130113 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.130094    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.130167 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.130116    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.130167 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.130126    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.130167 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.130138    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28b12b61-5e64-4b57-b723-a3b34120bb2d-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:23.130167 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:23.130159    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hltz7\" (UniqueName: \"kubernetes.io/projected/28b12b61-5e64-4b57-b723-a3b34120bb2d-kube-api-access-hltz7\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:41:24.389328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:24.389299    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" path="/var/lib/kubelet/pods/28b12b61-5e64-4b57-b723-a3b34120bb2d/volumes"
Jul 27 21:41:26.046519 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:26.046485    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:41:26.597960 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:26.597910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:26.976456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:26.976359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:27.278011 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.277980    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"]
Jul 27 21:41:27.278559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.278538    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy"
Jul 27 21:41:27.278707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.278562    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy"
Jul 27 21:41:27.278707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.278581    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy"
Jul 27 21:41:27.278707 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.278591    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy"
Jul 27 21:41:27.278930 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.278733    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy"
Jul 27 21:41:27.278930 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.278750    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b12b61-5e64-4b57-b723-a3b34120bb2d" containerName="istio-proxy"
Jul 27 21:41:27.283231 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.283212    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.289306 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.289273    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2cf6fc-openshift-default-dockercfg-wjksp\""
Jul 27 21:41:27.294211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.294180    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"]
Jul 27 21:41:27.317621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.317392    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:27.370450 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-istio-token\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370450 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8qz\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-kube-api-access-9v8qz\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370723 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0ba8387-a823-4778-9938-79e25f254f61-istiod-ca-cert\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370723 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0ba8387-a823-4778-9938-79e25f254f61-istio-podinfo\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370723 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-socket\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370723 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-certs\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370723 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-credential-socket\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-envoy\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.370942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.370775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-data\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.471806 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.471763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-credential-socket\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.471991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.471840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-envoy\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.471991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.471868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-data\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.471991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.471926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-istio-token\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.471991 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.471953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8qz\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-kube-api-access-9v8qz\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472238 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.471993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0ba8387-a823-4778-9938-79e25f254f61-istiod-ca-cert\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472238 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0ba8387-a823-4778-9938-79e25f254f61-istio-podinfo\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472238 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-socket\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472238 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-credential-socket\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472238 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-certs\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472523 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-data\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472580 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-certs\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472848 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472581    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-socket\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.472848 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.472800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0ba8387-a823-4778-9938-79e25f254f61-istiod-ca-cert\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.474436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.474417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-envoy\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.474820 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.474796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0ba8387-a823-4778-9938-79e25f254f61-istio-podinfo\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.480522 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.480502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8qz\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-kube-api-access-9v8qz\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.480726 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.480708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-istio-token\") pod \"e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") " pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.606165 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.606049    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:27.659825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.659782    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:27.779061 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.779037    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"]
Jul 27 21:41:27.781494 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:41:27.781470    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ba8387_a823_4778_9938_79e25f254f61.slice/crio-b2a2cec521ca8c1d9941c299aa1670da0e6c3e0046de019df22f743462eee8a9 WatchSource:0}: Error finding container b2a2cec521ca8c1d9941c299aa1670da0e6c3e0046de019df22f743462eee8a9: Status 404 returned error can't find the container with id b2a2cec521ca8c1d9941c299aa1670da0e6c3e0046de019df22f743462eee8a9
Jul 27 21:41:27.783719 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.783689    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:27.783801 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.783757    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:27.783801 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:27.783787    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:28.138291 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:28.138203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" event={"ID":"d0ba8387-a823-4778-9938-79e25f254f61","Type":"ContainerStarted","Data":"96b490f833a70d1d1ab4b62ab7ba4f59b18e83a1d1e1226e29cd471b48cc74a4"}
Jul 27 21:41:28.138291 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:28.138265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" event={"ID":"d0ba8387-a823-4778-9938-79e25f254f61","Type":"ContainerStarted","Data":"b2a2cec521ca8c1d9941c299aa1670da0e6c3e0046de019df22f743462eee8a9"}
Jul 27 21:41:28.158224 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:28.158171    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" podStartSLOduration=1.158147256 podStartE2EDuration="1.158147256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:28.15537526 +0000 UTC m=+2634.315765618" watchObservedRunningTime="2026-07-27 21:41:28.158147256 +0000 UTC m=+2634.318537614"
Jul 27 21:41:28.608846 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:28.608402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:28.608846 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:28.608510    2579 patch_prober.go:28] interesting pod/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 27 21:41:28.608846 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:28.608551    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 27 21:41:29.616666 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:29.616630    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:30.124836 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:30.124798    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:30.150749 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:30.150721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:30.151959 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:30.151934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:30.220482 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:30.220344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:30.377392 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:30.377304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:30.606353 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:30.606315    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:30.918467 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:30.918421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:31.009942 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:31.009902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:34.177318 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.177245    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerID="d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc" exitCode=0
Jul 27 21:41:34.177738 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.177325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" event={"ID":"ee115319-e150-4c54-8019-d40b59cb3a3c","Type":"ContainerDied","Data":"d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc"}
Jul 27 21:41:34.177819 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.177803    2579 scope.go:117] "RemoveContainer" containerID="d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc"
Jul 27 21:41:34.178997 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.178971    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:34.179064 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.179038    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:34.179108 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.179071    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:34.636248 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.636211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:34.745032 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:34.745004    2579 scope.go:117] "RemoveContainer" containerID="da636b7e78f4e858710e1699326cfa5b491969f2e7ff177539d20b346bb55f37"
Jul 27 21:41:35.184687 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:35.184648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" event={"ID":"ee115319-e150-4c54-8019-d40b59cb3a3c","Type":"ContainerStarted","Data":"2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c"}
Jul 27 21:41:35.965304 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:35.965259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:35.966341 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:35.966314    2579 patch_prober.go:28] interesting pod/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:41:35.966471 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:35.966366    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 21:41:36.090175 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:36.090132    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:36.965435 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:36.965402    2579 patch_prober.go:28] interesting pod/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:41:36.965946 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:36.965461    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 21:41:37.965471 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:37.965431    2579 patch_prober.go:28] interesting pod/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:41:37.965890 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:37.965488    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 21:41:38.965802 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:38.965719    2579 patch_prober.go:28] interesting pod/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:41:38.965802 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:38.965773    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 21:41:39.937181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:39.937141    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:41:39.970627 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:39.970583    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:39.971714 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:39.971688    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:41:42.272870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:42.272835    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0ba8387-a823-4778-9938-79e25f254f61" containerID="96b490f833a70d1d1ab4b62ab7ba4f59b18e83a1d1e1226e29cd471b48cc74a4" exitCode=0
Jul 27 21:41:42.273286 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:42.272908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" event={"ID":"d0ba8387-a823-4778-9938-79e25f254f61","Type":"ContainerDied","Data":"96b490f833a70d1d1ab4b62ab7ba4f59b18e83a1d1e1226e29cd471b48cc74a4"}
Jul 27 21:41:42.273344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:42.273310    2579 scope.go:117] "RemoveContainer" containerID="96b490f833a70d1d1ab4b62ab7ba4f59b18e83a1d1e1226e29cd471b48cc74a4"
Jul 27 21:41:42.274356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:42.274332    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:42.274429 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:42.274397    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:42.274466 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:42.274426    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:43.281196 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:43.281160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" event={"ID":"d0ba8387-a823-4778-9938-79e25f254f61","Type":"ContainerStarted","Data":"7f9be25d276f23f0308a83d236c25f21ef8b3e861a477bf6ab1c6637b0e6ba32"}
Jul 27 21:41:43.607520 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:43.607354    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:43.608904 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:43.608860    2579 patch_prober.go:28] interesting pod/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 27 21:41:43.609120 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:43.608931    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 27 21:41:44.607861 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:44.607821    2579 patch_prober.go:28] interesting pod/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 27 21:41:44.608381 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:44.607894    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 27 21:41:45.150660 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:45.150627    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:45.613627 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:45.606990    2579 patch_prober.go:28] interesting pod/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 27 21:41:45.613627 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:45.607057    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 27 21:41:45.632755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:45.632724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:41:46.606836 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:46.606791    2579 patch_prober.go:28] interesting pod/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 27 21:41:46.607046 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:46.606873    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 27 21:41:47.611137 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:47.611104    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:47.612482 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:47.612454    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:41:49.145463 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:41:49.145431    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:42:15.085654 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:42:15.085594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:42:18.849512 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:42:18.849484    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:42:34.568438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:42:34.568367    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:42:34.574964 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:42:34.574939    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:42:43.600618 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:42:43.600564    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:42:46.641859 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:42:46.641824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:43:06.850833 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:43:06.850789    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:43:24.841438 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:43:24.841402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:43:46.854582 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:43:46.854550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:44:05.337459 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:44:05.337379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:44:27.845821 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:44:27.845781    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:44:44.948569 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:44:44.948528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:45:00.137094 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.137061    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"]
Jul 27 21:45:00.139553 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.139536    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"]
Jul 27 21:45:00.139682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.139663    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"
Jul 27 21:45:00.141986 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.141965    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22s5m\""
Jul 27 21:45:00.142213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.142197    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp"]
Jul 27 21:45:00.142326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.142310    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"
Jul 27 21:45:00.144462 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.144445    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp"
Jul 27 21:45:00.150657 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.150638    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"
Jul 27 21:45:00.153953 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.153913    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"]
Jul 27 21:45:00.157531 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.157496    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp"]
Jul 27 21:45:00.162947 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.162926    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"
Jul 27 21:45:00.170017 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.169992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"]
Jul 27 21:45:00.195054 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.195030    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp"
Jul 27 21:45:00.369012 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.368984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp"]
Jul 27 21:45:00.370952 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:45:00.370930    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e8c617_0d7f_43eb_b8c6_2492456b4c19.slice/crio-c9c3c54848295ea95c50e6eaff5e0a2c0deef439d4c9926b3879a91e9c9504a3 WatchSource:0}: Error finding container c9c3c54848295ea95c50e6eaff5e0a2c0deef439d4c9926b3879a91e9c9504a3: Status 404 returned error can't find the container with id c9c3c54848295ea95c50e6eaff5e0a2c0deef439d4c9926b3879a91e9c9504a3
Jul 27 21:45:00.390572 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.390542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp" event={"ID":"b2e8c617-0d7f-43eb-b8c6-2492456b4c19","Type":"ContainerStarted","Data":"c9c3c54848295ea95c50e6eaff5e0a2c0deef439d4c9926b3879a91e9c9504a3"}
Jul 27 21:45:00.527352 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:45:00.527297    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff81b0b1_81c6_4b96_bdd8_8b30c382038a.slice/crio-72f96d1ad58264a8f1250d4823f7634dd5379081fdf982cfc5f3e357afa0cd91 WatchSource:0}: Error finding container 72f96d1ad58264a8f1250d4823f7634dd5379081fdf982cfc5f3e357afa0cd91: Status 404 returned error can't find the container with id 72f96d1ad58264a8f1250d4823f7634dd5379081fdf982cfc5f3e357afa0cd91
Jul 27 21:45:00.527490 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.527348    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"]
Jul 27 21:45:00.552261 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:00.552238    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"]
Jul 27 21:45:00.553760 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:45:00.553735    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3533dea_598e_4257_9dca_5ee142d4d805.slice/crio-b7566049c8525e0aa226d5764f97f8116414a9f9829c7be03a649900ff472b1d WatchSource:0}: Error finding container b7566049c8525e0aa226d5764f97f8116414a9f9829c7be03a649900ff472b1d: Status 404 returned error can't find the container with id b7566049c8525e0aa226d5764f97f8116414a9f9829c7be03a649900ff472b1d
Jul 27 21:45:01.398217 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.398189    2579 generic.go:356] "Generic (PLEG): container finished" podID="b2e8c617-0d7f-43eb-b8c6-2492456b4c19" containerID="6a2be62f251b198fbadcaf2d411fbedd2f56cecefd34ffb7fbee721eb2ca26cc" exitCode=0
Jul 27 21:45:01.398563 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.398277    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp" event={"ID":"b2e8c617-0d7f-43eb-b8c6-2492456b4c19","Type":"ContainerDied","Data":"6a2be62f251b198fbadcaf2d411fbedd2f56cecefd34ffb7fbee721eb2ca26cc"}
Jul 27 21:45:01.399929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.399902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl" event={"ID":"ff81b0b1-81c6-4b96-bdd8-8b30c382038a","Type":"ContainerStarted","Data":"f2a90ed5afeeba15cd5ea94bd28f32f278832988ba299702108fa85475158060"}
Jul 27 21:45:01.400046 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.399952    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl" event={"ID":"ff81b0b1-81c6-4b96-bdd8-8b30c382038a","Type":"ContainerStarted","Data":"72f96d1ad58264a8f1250d4823f7634dd5379081fdf982cfc5f3e357afa0cd91"}
Jul 27 21:45:01.401373 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.401350    2579 generic.go:356] "Generic (PLEG): container finished" podID="c3533dea-598e-4257-9dca-5ee142d4d805" containerID="67084b25d1886eadcfebc5f1a6e51f8419a239205910f0f677a42e263350f1ff" exitCode=0
Jul 27 21:45:01.401445 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.401393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4" event={"ID":"c3533dea-598e-4257-9dca-5ee142d4d805","Type":"ContainerDied","Data":"67084b25d1886eadcfebc5f1a6e51f8419a239205910f0f677a42e263350f1ff"}
Jul 27 21:45:01.401445 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.401433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4" event={"ID":"c3533dea-598e-4257-9dca-5ee142d4d805","Type":"ContainerStarted","Data":"b7566049c8525e0aa226d5764f97f8116414a9f9829c7be03a649900ff472b1d"}
Jul 27 21:45:01.426525 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:01.426473    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl" podStartSLOduration=1.4264598689999999 podStartE2EDuration="1.426459869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:45:01.425890111 +0000 UTC m=+2847.586280475" watchObservedRunningTime="2026-07-27 21:45:01.426459869 +0000 UTC m=+2847.586850227"
Jul 27 21:45:02.407768 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:02.407740    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff81b0b1-81c6-4b96-bdd8-8b30c382038a" containerID="f2a90ed5afeeba15cd5ea94bd28f32f278832988ba299702108fa85475158060" exitCode=0
Jul 27 21:45:02.408180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:02.407791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl" event={"ID":"ff81b0b1-81c6-4b96-bdd8-8b30c382038a","Type":"ContainerDied","Data":"f2a90ed5afeeba15cd5ea94bd28f32f278832988ba299702108fa85475158060"}
Jul 27 21:45:02.545708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:02.545684    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"
Jul 27 21:45:02.576261 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:02.576234    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp"
Jul 27 21:45:03.414465 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:03.414439    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"
Jul 27 21:45:03.414465 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:03.414455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4" event={"ID":"c3533dea-598e-4257-9dca-5ee142d4d805","Type":"ContainerDied","Data":"b7566049c8525e0aa226d5764f97f8116414a9f9829c7be03a649900ff472b1d"}
Jul 27 21:45:03.414929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:03.414503    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7566049c8525e0aa226d5764f97f8116414a9f9829c7be03a649900ff472b1d"
Jul 27 21:45:03.415828 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:03.415794    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp"
Jul 27 21:45:03.415930 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:03.415825    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-g85fp" event={"ID":"b2e8c617-0d7f-43eb-b8c6-2492456b4c19","Type":"ContainerDied","Data":"c9c3c54848295ea95c50e6eaff5e0a2c0deef439d4c9926b3879a91e9c9504a3"}
Jul 27 21:45:03.415930 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:03.415864    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9c3c54848295ea95c50e6eaff5e0a2c0deef439d4c9926b3879a91e9c9504a3"
Jul 27 21:45:03.541753 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:03.541733    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"
Jul 27 21:45:04.422880 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:04.422855    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"
Jul 27 21:45:04.422880 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:04.422869    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl" event={"ID":"ff81b0b1-81c6-4b96-bdd8-8b30c382038a","Type":"ContainerDied","Data":"72f96d1ad58264a8f1250d4823f7634dd5379081fdf982cfc5f3e357afa0cd91"}
Jul 27 21:45:04.423237 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:04.422908    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72f96d1ad58264a8f1250d4823f7634dd5379081fdf982cfc5f3e357afa0cd91"
Jul 27 21:45:07.734685 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:07.734651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:45:27.147481 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:27.147405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:45:34.800676 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:34.800646    2579 scope.go:117] "RemoveContainer" containerID="962ae2e62cb349765b6c1ef23c3d89f1ef29b7f30f35472ca18031602d1c539b"
Jul 27 21:45:48.638125 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:48.638093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:45:49.749827 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:49.749797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:45:50.440339 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:45:50.440311    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:46:08.658452 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:46:08.658420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:46:30.154955 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:46:30.154916    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:46:34.821550 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:46:34.821515    2579 scope.go:117] "RemoveContainer" containerID="03a5fb93faedf7988158181a5034b9ddc3d9bed486edd5faaa23ee640ec0f8dd"
Jul 27 21:46:36.060534 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:46:36.060499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:46:36.882861 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:46:36.882832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:46:44.532791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:46:44.532760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:46:48.664575 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:46:48.664542    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:47:04.521177 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:47:04.521102    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:47:27.476080 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:47:27.476041    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:47:31.072134 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:47:31.072089    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:47:34.608940 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:47:34.608908    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:47:34.617082 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:47:34.617055    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:47:34.843058 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:47:34.843030    2579 scope.go:117] "RemoveContainer" containerID="78cb4048345e5088a6203ac0f1c1f8e7da04b737becca161da8c87d1c37d9651"
Jul 27 21:48:16.353987 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:48:16.353951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:48:37.445500 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:48:37.445458    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:48:43.045789 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:48:43.045753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:48:43.925416 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:48:43.925381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:48:55.646691 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:48:55.646651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:49:01.127711 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:49:01.127662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:49:06.661545 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:49:06.661502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:49:17.033443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:49:17.033412    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:49:29.242772 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:49:29.242738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:49:32.658514 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:49:32.658476    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:50:02.843312 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:02.843228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:50:09.613650 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:09.613586    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:09.724396 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:09.724364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:23.367849 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:23.367811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:50:29.889035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:29.888998    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:30.734408 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:30.734376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:31.747652 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.747615    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7480-140349426547120"]
Jul 27 21:50:31.748021 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.747991    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3533dea-598e-4257-9dca-5ee142d4d805" containerName="cleanup"
Jul 27 21:50:31.748021 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748003    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3533dea-598e-4257-9dca-5ee142d4d805" containerName="cleanup"
Jul 27 21:50:31.748021 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748013    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e8c617-0d7f-43eb-b8c6-2492456b4c19" containerName="cleanup"
Jul 27 21:50:31.748021 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748019    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e8c617-0d7f-43eb-b8c6-2492456b4c19" containerName="cleanup"
Jul 27 21:50:31.748157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748043    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff81b0b1-81c6-4b96-bdd8-8b30c382038a" containerName="cleanup"
Jul 27 21:50:31.748157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748048    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff81b0b1-81c6-4b96-bdd8-8b30c382038a" containerName="cleanup"
Jul 27 21:50:31.748157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748106    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e8c617-0d7f-43eb-b8c6-2492456b4c19" containerName="cleanup"
Jul 27 21:50:31.748157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748113    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff81b0b1-81c6-4b96-bdd8-8b30c382038a" containerName="cleanup"
Jul 27 21:50:31.748157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.748119    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3533dea-598e-4257-9dca-5ee142d4d805" containerName="cleanup"
Jul 27 21:50:31.751274 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.751258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:31.754169 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.754144    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gh797\""
Jul 27 21:50:31.756201 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.756178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7480-140349426547120"]
Jul 27 21:50:31.839708 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.839669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlpgt\" (UniqueName: \"kubernetes.io/projected/2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe-kube-api-access-mlpgt\") pod \"test-curl-7480-140349426547120\" (UID: \"2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe\") " pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:31.940889 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.940854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlpgt\" (UniqueName: \"kubernetes.io/projected/2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe-kube-api-access-mlpgt\") pod \"test-curl-7480-140349426547120\" (UID: \"2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe\") " pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:31.949151 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:31.949123    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlpgt\" (UniqueName: \"kubernetes.io/projected/2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe-kube-api-access-mlpgt\") pod \"test-curl-7480-140349426547120\" (UID: \"2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe\") " pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:32.062526 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:32.062488    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:32.197939 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:32.197914    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7480-140349426547120"]
Jul 27 21:50:32.198971 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:50:32.198947    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ecfd6b1_f9ce_4643_ac7e_86c683e51ffe.slice/crio-ee627a6ce706f2a0a6fc652d2a329f2f3923b6f4e85c4c05ed9dd5f758ccb994 WatchSource:0}: Error finding container ee627a6ce706f2a0a6fc652d2a329f2f3923b6f4e85c4c05ed9dd5f758ccb994: Status 404 returned error can't find the container with id ee627a6ce706f2a0a6fc652d2a329f2f3923b6f4e85c4c05ed9dd5f758ccb994
Jul 27 21:50:32.200662 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:32.200644    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:50:32.280821 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:32.280792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7480-140349426547120" event={"ID":"2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe","Type":"ContainerStarted","Data":"ee627a6ce706f2a0a6fc652d2a329f2f3923b6f4e85c4c05ed9dd5f758ccb994"}
Jul 27 21:50:33.287790 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:33.287760    2579 generic.go:356] "Generic (PLEG): container finished" podID="2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe" containerID="f7d68c6b0f4b4e0851c54ee45ad3b41c23c17681d8ed2e8ebe645651df0633b1" exitCode=0
Jul 27 21:50:33.288140 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:33.287846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7480-140349426547120" event={"ID":"2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe","Type":"ContainerDied","Data":"f7d68c6b0f4b4e0851c54ee45ad3b41c23c17681d8ed2e8ebe645651df0633b1"}
Jul 27 21:50:34.424953 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:34.424920    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:34.444775 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:34.444755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7480-140349426547120_2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe/test-curl-7480-140349426547120/0.log"
Jul 27 21:50:34.469334 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:34.469312    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7480-140349426547120"]
Jul 27 21:50:34.471538 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:34.471518    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7480-140349426547120"]
Jul 27 21:50:34.563344 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:34.563293    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlpgt\" (UniqueName: \"kubernetes.io/projected/2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe-kube-api-access-mlpgt\") pod \"2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe\" (UID: \"2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe\") "
Jul 27 21:50:34.565425 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:34.565403    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe-kube-api-access-mlpgt" (OuterVolumeSpecName: "kube-api-access-mlpgt") pod "2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe" (UID: "2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe"). InnerVolumeSpecName "kube-api-access-mlpgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:50:34.664410 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:34.664378    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlpgt\" (UniqueName: \"kubernetes.io/projected/2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe-kube-api-access-mlpgt\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:50:35.299025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:35.298995    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:35.299160 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:35.299042    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee627a6ce706f2a0a6fc652d2a329f2f3923b6f4e85c4c05ed9dd5f758ccb994"
Jul 27 21:50:35.308815 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:50:35.308792    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7480-140349426547120\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" podUID="2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe" pod="opendatahub/test-curl-7480-140349426547120"
Jul 27 21:50:36.389558 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:36.389524    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe" path="/var/lib/kubelet/pods/2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe/volumes"
Jul 27 21:50:39.147459 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:39.147425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:50:40.629082 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.629048    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7480-140349431523200"]
Jul 27 21:50:40.629445 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.629402    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe" containerName="test-curl-7480-140349426547120"
Jul 27 21:50:40.629445 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.629414    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe" containerName="test-curl-7480-140349426547120"
Jul 27 21:50:40.629566 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.629495    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ecfd6b1-f9ce-4643-ac7e-86c683e51ffe" containerName="test-curl-7480-140349426547120"
Jul 27 21:50:40.632686 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.632671    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:40.635184 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.635161    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gh797\""
Jul 27 21:50:40.639976 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.639952    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7480-140349431523200"]
Jul 27 21:50:40.819469 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.819428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqfs5\" (UniqueName: \"kubernetes.io/projected/6154a9c2-cc40-49d7-af35-b2fafd8bf09d-kube-api-access-vqfs5\") pod \"test-curl-7480-140349431523200\" (UID: \"6154a9c2-cc40-49d7-af35-b2fafd8bf09d\") " pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:40.920332 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.920265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqfs5\" (UniqueName: \"kubernetes.io/projected/6154a9c2-cc40-49d7-af35-b2fafd8bf09d-kube-api-access-vqfs5\") pod \"test-curl-7480-140349431523200\" (UID: \"6154a9c2-cc40-49d7-af35-b2fafd8bf09d\") " pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:40.928953 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.928923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqfs5\" (UniqueName: \"kubernetes.io/projected/6154a9c2-cc40-49d7-af35-b2fafd8bf09d-kube-api-access-vqfs5\") pod \"test-curl-7480-140349431523200\" (UID: \"6154a9c2-cc40-49d7-af35-b2fafd8bf09d\") " pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:40.942686 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:40.942664    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:41.074119 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:41.074088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7480-140349431523200"]
Jul 27 21:50:41.075502 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:50:41.075479    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6154a9c2_cc40_49d7_af35_b2fafd8bf09d.slice/crio-aa602035a4e704e25dc3fac65736b406447300e5d50e346ce8c8d2527e7f18a1 WatchSource:0}: Error finding container aa602035a4e704e25dc3fac65736b406447300e5d50e346ce8c8d2527e7f18a1: Status 404 returned error can't find the container with id aa602035a4e704e25dc3fac65736b406447300e5d50e346ce8c8d2527e7f18a1
Jul 27 21:50:41.332768 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:41.332738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7480-140349431523200" event={"ID":"6154a9c2-cc40-49d7-af35-b2fafd8bf09d","Type":"ContainerStarted","Data":"aa602035a4e704e25dc3fac65736b406447300e5d50e346ce8c8d2527e7f18a1"}
Jul 27 21:50:42.339860 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:42.339823    2579 generic.go:356] "Generic (PLEG): container finished" podID="6154a9c2-cc40-49d7-af35-b2fafd8bf09d" containerID="135c0e1762016286a8455bc323baf0277bfe0fa3db83dd10b9fc3952b2415b32" exitCode=0
Jul 27 21:50:42.340224 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:42.339907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7480-140349431523200" event={"ID":"6154a9c2-cc40-49d7-af35-b2fafd8bf09d","Type":"ContainerDied","Data":"135c0e1762016286a8455bc323baf0277bfe0fa3db83dd10b9fc3952b2415b32"}
Jul 27 21:50:43.485088 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.485065    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:43.507329 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.507306    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7480-140349431523200_6154a9c2-cc40-49d7-af35-b2fafd8bf09d/test-curl-7480-140349431523200/0.log"
Jul 27 21:50:43.540223 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.540202    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7480-140349431523200"]
Jul 27 21:50:43.544436 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.544410    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7480-140349431523200"]
Jul 27 21:50:43.640154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.640085    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqfs5\" (UniqueName: \"kubernetes.io/projected/6154a9c2-cc40-49d7-af35-b2fafd8bf09d-kube-api-access-vqfs5\") pod \"6154a9c2-cc40-49d7-af35-b2fafd8bf09d\" (UID: \"6154a9c2-cc40-49d7-af35-b2fafd8bf09d\") "
Jul 27 21:50:43.642272 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.642249    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6154a9c2-cc40-49d7-af35-b2fafd8bf09d-kube-api-access-vqfs5" (OuterVolumeSpecName: "kube-api-access-vqfs5") pod "6154a9c2-cc40-49d7-af35-b2fafd8bf09d" (UID: "6154a9c2-cc40-49d7-af35-b2fafd8bf09d"). InnerVolumeSpecName "kube-api-access-vqfs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:50:43.682314 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.682291    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7480-140349426513504"]
Jul 27 21:50:43.682730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.682716    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6154a9c2-cc40-49d7-af35-b2fafd8bf09d" containerName="test-curl-7480-140349431523200"
Jul 27 21:50:43.682787 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.682733    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6154a9c2-cc40-49d7-af35-b2fafd8bf09d" containerName="test-curl-7480-140349431523200"
Jul 27 21:50:43.682827 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.682815    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6154a9c2-cc40-49d7-af35-b2fafd8bf09d" containerName="test-curl-7480-140349431523200"
Jul 27 21:50:43.685698 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.685683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:43.693565 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.693539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7480-140349426513504"]
Jul 27 21:50:43.741077 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.741052    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqfs5\" (UniqueName: \"kubernetes.io/projected/6154a9c2-cc40-49d7-af35-b2fafd8bf09d-kube-api-access-vqfs5\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:50:43.841855 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.841823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwq9\" (UniqueName: \"kubernetes.io/projected/fb7a7a92-18c1-424b-9dee-ed7716fb5532-kube-api-access-zkwq9\") pod \"test-curl-7480-140349426513504\" (UID: \"fb7a7a92-18c1-424b-9dee-ed7716fb5532\") " pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:43.942918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.942854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwq9\" (UniqueName: \"kubernetes.io/projected/fb7a7a92-18c1-424b-9dee-ed7716fb5532-kube-api-access-zkwq9\") pod \"test-curl-7480-140349426513504\" (UID: \"fb7a7a92-18c1-424b-9dee-ed7716fb5532\") " pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:43.951457 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.951434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwq9\" (UniqueName: \"kubernetes.io/projected/fb7a7a92-18c1-424b-9dee-ed7716fb5532-kube-api-access-zkwq9\") pod \"test-curl-7480-140349426513504\" (UID: \"fb7a7a92-18c1-424b-9dee-ed7716fb5532\") " pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:43.995249 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:43.995217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:44.134329 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:44.134300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7480-140349426513504"]
Jul 27 21:50:44.135929 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:50:44.135904    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb7a7a92_18c1_424b_9dee_ed7716fb5532.slice/crio-444cad275f36d0b44767baa90dfff25bc4468ae5bd5e366ad04407a1617012f8 WatchSource:0}: Error finding container 444cad275f36d0b44767baa90dfff25bc4468ae5bd5e366ad04407a1617012f8: Status 404 returned error can't find the container with id 444cad275f36d0b44767baa90dfff25bc4468ae5bd5e366ad04407a1617012f8
Jul 27 21:50:44.352548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:44.352505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7480-140349426513504" event={"ID":"fb7a7a92-18c1-424b-9dee-ed7716fb5532","Type":"ContainerStarted","Data":"444cad275f36d0b44767baa90dfff25bc4468ae5bd5e366ad04407a1617012f8"}
Jul 27 21:50:44.353757 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:44.353739    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa602035a4e704e25dc3fac65736b406447300e5d50e346ce8c8d2527e7f18a1"
Jul 27 21:50:44.353868 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:44.353779    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:44.364079 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:50:44.364053    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7480-140349431523200\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" podUID="6154a9c2-cc40-49d7-af35-b2fafd8bf09d" pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:44.388735 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:50:44.388704    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7480-140349431523200\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" podUID="6154a9c2-cc40-49d7-af35-b2fafd8bf09d" pod="opendatahub/test-curl-7480-140349431523200"
Jul 27 21:50:44.389965 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:44.389948    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6154a9c2-cc40-49d7-af35-b2fafd8bf09d" path="/var/lib/kubelet/pods/6154a9c2-cc40-49d7-af35-b2fafd8bf09d/volumes"
Jul 27 21:50:45.360861 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:45.360832    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb7a7a92-18c1-424b-9dee-ed7716fb5532" containerID="70e5e4325b6da896f2b80e8da2f1329c345cce2f9ddb279fd37421094f9ca1b1" exitCode=0
Jul 27 21:50:45.361302 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:45.360923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7480-140349426513504" event={"ID":"fb7a7a92-18c1-424b-9dee-ed7716fb5532","Type":"ContainerDied","Data":"70e5e4325b6da896f2b80e8da2f1329c345cce2f9ddb279fd37421094f9ca1b1"}
Jul 27 21:50:46.506348 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:46.506322    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:46.529401 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:46.529381    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7480-140349426513504_fb7a7a92-18c1-424b-9dee-ed7716fb5532/test-curl-7480-140349426513504/0.log"
Jul 27 21:50:46.556358 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:46.556330    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7480-140349426513504"]
Jul 27 21:50:46.561431 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:46.561407    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7480-140349426513504"]
Jul 27 21:50:46.565900 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:46.565879    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkwq9\" (UniqueName: \"kubernetes.io/projected/fb7a7a92-18c1-424b-9dee-ed7716fb5532-kube-api-access-zkwq9\") pod \"fb7a7a92-18c1-424b-9dee-ed7716fb5532\" (UID: \"fb7a7a92-18c1-424b-9dee-ed7716fb5532\") "
Jul 27 21:50:46.568143 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:46.568121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7a7a92-18c1-424b-9dee-ed7716fb5532-kube-api-access-zkwq9" (OuterVolumeSpecName: "kube-api-access-zkwq9") pod "fb7a7a92-18c1-424b-9dee-ed7716fb5532" (UID: "fb7a7a92-18c1-424b-9dee-ed7716fb5532"). InnerVolumeSpecName "kube-api-access-zkwq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:50:46.667198 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:46.667126    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkwq9\" (UniqueName: \"kubernetes.io/projected/fb7a7a92-18c1-424b-9dee-ed7716fb5532-kube-api-access-zkwq9\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:50:47.373155 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:47.373125    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="444cad275f36d0b44767baa90dfff25bc4468ae5bd5e366ad04407a1617012f8"
Jul 27 21:50:47.373155 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:47.373148    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:47.383444 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:50:47.383417    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7480-140349426513504\" is forbidden: User \"system:node:ip-10-0-143-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-7.ec2.internal' and this object" podUID="fb7a7a92-18c1-424b-9dee-ed7716fb5532" pod="opendatahub/test-curl-7480-140349426513504"
Jul 27 21:50:48.389164 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:48.389130    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb7a7a92-18c1-424b-9dee-ed7716fb5532" path="/var/lib/kubelet/pods/fb7a7a92-18c1-424b-9dee-ed7716fb5532/volumes"
Jul 27 21:50:50.074012 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.073978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:50.381900 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.381824    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"]
Jul 27 21:50:50.382245 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.382231    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7a7a92-18c1-424b-9dee-ed7716fb5532" containerName="test-curl-7480-140349426513504"
Jul 27 21:50:50.382292 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.382247    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7a7a92-18c1-424b-9dee-ed7716fb5532" containerName="test-curl-7480-140349426513504"
Jul 27 21:50:50.382327 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.382313    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb7a7a92-18c1-424b-9dee-ed7716fb5532" containerName="test-curl-7480-140349426513504"
Jul 27 21:50:50.385500 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.385479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.387957 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.387934    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-262475-openshift-default-dockercfg-zdb8q\""
Jul 27 21:50:50.396256 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-socket\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396415 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-certs\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396415 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ppn\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-kube-api-access-r4ppn\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-credential-socket\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-podinfo\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396543 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-envoy\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396795 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-data\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396795 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-token\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.396795 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.396673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09914423-a7c8-4ea4-b1b7-49efeb260143-istiod-ca-cert\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.397458 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.397243    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"]
Jul 27 21:50:50.497229 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-credential-socket\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-podinfo\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-envoy\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-data\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-token\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09914423-a7c8-4ea4-b1b7-49efeb260143-istiod-ca-cert\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-socket\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497443 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-certs\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ppn\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-kube-api-access-r4ppn\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-credential-socket\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.497825 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.497801    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-data\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.498236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.498198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09914423-a7c8-4ea4-b1b7-49efeb260143-istiod-ca-cert\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.498369 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.498247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-socket\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.498369 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.498308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-certs\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.500454 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.500429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-envoy\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.500584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.500461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-podinfo\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.506272 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.506248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-token\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.506441 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.506425    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ppn\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-kube-api-access-r4ppn\") pod \"e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") " pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.698320 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.698238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:50.838059 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.838026    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"]
Jul 27 21:50:50.838457 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:50:50.838425    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09914423_a7c8_4ea4_b1b7_49efeb260143.slice/crio-e4d28d13c20db74c643203f5e87b2b4dc653f7e26972462f34a1438db1d22d5c WatchSource:0}: Error finding container e4d28d13c20db74c643203f5e87b2b4dc653f7e26972462f34a1438db1d22d5c: Status 404 returned error can't find the container with id e4d28d13c20db74c643203f5e87b2b4dc653f7e26972462f34a1438db1d22d5c
Jul 27 21:50:50.840695 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.840656    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:50:50.840767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.840734    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:50:50.840807 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:50.840775    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:50:51.405532 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:51.405496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" event={"ID":"09914423-a7c8-4ea4-b1b7-49efeb260143","Type":"ContainerStarted","Data":"694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659"}
Jul 27 21:50:51.405964 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:51.405551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" event={"ID":"09914423-a7c8-4ea4-b1b7-49efeb260143","Type":"ContainerStarted","Data":"e4d28d13c20db74c643203f5e87b2b4dc653f7e26972462f34a1438db1d22d5c"}
Jul 27 21:50:51.427068 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:51.427022    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" podStartSLOduration=1.427005908 podStartE2EDuration="1.427005908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:50:51.424823731 +0000 UTC m=+3197.585214116" watchObservedRunningTime="2026-07-27 21:50:51.427005908 +0000 UTC m=+3197.587396267"
Jul 27 21:50:51.699430 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:51.699352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:51.704294 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:51.704271    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:52.215025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:52.214995    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:52.410742 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:52.410713    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:52.411491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:52.411473    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:50:53.424852 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:53.424806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:53.523933 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:53.523900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:53.647369 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:53.647333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:53.957585 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:53.957545    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:54.364171 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:54.364137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:54.463767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:54.463735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:50:57.975767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:50:57.975736    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:01.552528 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:01.552492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:51:08.452730 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:08.452692    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 21:51:08.453230 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:08.452770    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 21:51:08.949408 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:08.949367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:09.257584 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.257490    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"]
Jul 27 21:51:09.263944 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.263923    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.266405 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.266387    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-c3af52-openshift-default-dockercfg-tp4v8\""
Jul 27 21:51:09.272007 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.271981    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"]
Jul 27 21:51:09.302123 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.302093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:09.372635 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-socket\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.372817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-data\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.372817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-envoy\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.372817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-token\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.372817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-certs\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.372817 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6nn\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-kube-api-access-sp6nn\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.373103 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-podinfo\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.373103 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istiod-ca-cert\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.373103 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.372903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-credential-socket\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474355 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6nn\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-kube-api-access-sp6nn\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-podinfo\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istiod-ca-cert\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-credential-socket\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-socket\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-data\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-envoy\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-token\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.474791 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.474620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-certs\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.475252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.475000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-credential-socket\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.475252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.475032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-certs\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.475252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.475086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-data\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.475252 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.475211    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-socket\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.475472 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.475362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istiod-ca-cert\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.477160 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.477141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-podinfo\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.477309 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.477293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-envoy\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.484881 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.484859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6nn\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-kube-api-access-sp6nn\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.485156 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.485136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-token\") pod \"e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") " pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.578265 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.578238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:09.588231 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.588202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:09.725928 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.725905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"]
Jul 27 21:51:09.726452 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:51:09.726431    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fa9d22_7c5f_4538_bf24_465fcb1b282f.slice/crio-a51cdb7891427ec1b243a3d03ccf90c188a31adc2e39147d4bff4cffea2e0111 WatchSource:0}: Error finding container a51cdb7891427ec1b243a3d03ccf90c188a31adc2e39147d4bff4cffea2e0111: Status 404 returned error can't find the container with id a51cdb7891427ec1b243a3d03ccf90c188a31adc2e39147d4bff4cffea2e0111
Jul 27 21:51:09.728718 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.728679    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:09.728790 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.728751    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:09.728790 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:09.728784    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:10.522478 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.522445    2579 generic.go:356] "Generic (PLEG): container finished" podID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerID="694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659" exitCode=0
Jul 27 21:51:10.522967 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.522524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" event={"ID":"09914423-a7c8-4ea4-b1b7-49efeb260143","Type":"ContainerDied","Data":"694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659"}
Jul 27 21:51:10.523041 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.523024    2579 scope.go:117] "RemoveContainer" containerID="694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659"
Jul 27 21:51:10.524147 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.524127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" event={"ID":"12fa9d22-7c5f-4538-bf24-465fcb1b282f","Type":"ContainerStarted","Data":"fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9"}
Jul 27 21:51:10.524236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.524167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" event={"ID":"12fa9d22-7c5f-4538-bf24-465fcb1b282f","Type":"ContainerStarted","Data":"a51cdb7891427ec1b243a3d03ccf90c188a31adc2e39147d4bff4cffea2e0111"}
Jul 27 21:51:10.524236 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.524195    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:10.524316 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.524291    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:10.524352 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.524340    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:10.571227 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.571170    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" podStartSLOduration=1.571148448 podStartE2EDuration="1.571148448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:51:10.567826577 +0000 UTC m=+3216.728216963" watchObservedRunningTime="2026-07-27 21:51:10.571148448 +0000 UTC m=+3216.731538811"
Jul 27 21:51:10.579075 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.579037    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:10.585852 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:10.585830    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:11.532752 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:11.532714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" event={"ID":"09914423-a7c8-4ea4-b1b7-49efeb260143","Type":"ContainerStarted","Data":"6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27"}
Jul 27 21:51:11.533356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:11.532868    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:11.533929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:11.533907    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:11.700101 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:11.700059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:51:11.700314 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:11.700248    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 21:51:11.700395 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:11.700307    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 21:51:12.553402 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:12.553349    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:12.642796 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:12.642760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:12.714778 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:12.714740    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 21:51:12.714948 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:12.714823    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 21:51:12.733727 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:12.733690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:12.835564 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:12.835463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:13.425867 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:13.425830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:13.528179 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:13.528143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:13.699743 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:13.699639    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 21:51:13.699743 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:13.699723    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 21:51:14.698956 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:14.698911    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 21:51:14.699167 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:14.698991    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 21:51:15.702474 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:15.702445    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:51:15.702873 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:15.702859    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:51:15.703639 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:15.703591    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:51:16.258516 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:16.258486    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:51:17.090128 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:17.090093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:24.610509 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:24.610481    2579 generic.go:356] "Generic (PLEG): container finished" podID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerID="fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9" exitCode=0
Jul 27 21:51:24.610890 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:24.610552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" event={"ID":"12fa9d22-7c5f-4538-bf24-465fcb1b282f","Type":"ContainerDied","Data":"fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9"}
Jul 27 21:51:24.610995 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:24.610980    2579 scope.go:117] "RemoveContainer" containerID="fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9"
Jul 27 21:51:24.612146 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:24.612117    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:24.612209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:24.612190    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:24.612249 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:24.612223    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:51:25.622139 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:25.622104    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" event={"ID":"12fa9d22-7c5f-4538-bf24-465fcb1b282f","Type":"ContainerStarted","Data":"b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee"}
Jul 27 21:51:26.533632 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:26.533576    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:26.578989 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:26.578958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:26.580198 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:26.580168    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 21:51:26.580322 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:26.580215    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 21:51:27.578994 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:27.578954    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 21:51:27.579406 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:27.579028    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 21:51:28.578658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:28.578626    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 21:51:28.578811 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:28.578702    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 21:51:29.582952 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:29.582925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:29.584035 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:29.584012    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:51:54.077388 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:54.077358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:51:57.152962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:51:57.152930    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:52:24.761547 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:24.761511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:25.075189 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:25.075155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:52:34.652016 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:34.651987    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:52:34.660533 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:34.660515    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:52:35.442647 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.442612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:35.751849 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.751775    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"]
Jul 27 21:52:35.754396 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.754378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.756929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.756905    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ad54ee-openshift-default-dockercfg-pg9vp\""
Jul 27 21:52:35.767079 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.767059    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"]
Jul 27 21:52:35.770258 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.770238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:35.856756 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.856716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwncq\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-kube-api-access-zwncq\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857034 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-token\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857223 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/692af447-c3f3-49e2-99f5-660f7ad02ec2-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857365 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-podinfo\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857510 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-socket\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857510 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-certs\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857510 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-credential-socket\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857727 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-data\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.857727 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.857564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-envoy\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.958888 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.958853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-podinfo\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.958899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-socket\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.958935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-certs\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.958973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-credential-socket\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.958998    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-data\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959062 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-envoy\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959292 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwncq\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-kube-api-access-zwncq\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959292 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-token\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959292 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/692af447-c3f3-49e2-99f5-660f7ad02ec2-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959416 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-socket\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959758 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959735    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-certs\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.959829 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/692af447-c3f3-49e2-99f5-660f7ad02ec2-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.960005 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.959982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-credential-socket\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.960071 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.960003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-data\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.961513 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.961496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-podinfo\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.961638 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.961618    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-envoy\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.966875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.966849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwncq\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-kube-api-access-zwncq\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:35.966965 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:35.966920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-token\") pod \"e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") " pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:36.066507 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:36.066482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:36.210128 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:36.210099    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"]
Jul 27 21:52:36.211225 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:52:36.211202    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692af447_c3f3_49e2_99f5_660f7ad02ec2.slice/crio-56668fc7062e810c51c1a88668dc624426591ddb3292db093a27c73c60a99faa WatchSource:0}: Error finding container 56668fc7062e810c51c1a88668dc624426591ddb3292db093a27c73c60a99faa: Status 404 returned error can't find the container with id 56668fc7062e810c51c1a88668dc624426591ddb3292db093a27c73c60a99faa
Jul 27 21:52:36.213640 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:36.213588    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:52:36.213755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:36.213692    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:52:36.213755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:36.213737    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:52:36.216456 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:36.216436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:37.065962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:37.065925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" event={"ID":"692af447-c3f3-49e2-99f5-660f7ad02ec2","Type":"ContainerStarted","Data":"9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde"}
Jul 27 21:52:37.066340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:37.065989    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" event={"ID":"692af447-c3f3-49e2-99f5-660f7ad02ec2","Type":"ContainerStarted","Data":"56668fc7062e810c51c1a88668dc624426591ddb3292db093a27c73c60a99faa"}
Jul 27 21:52:37.067216 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:37.067198    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:37.072570 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:37.072547    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:37.088467 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:37.088417    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" podStartSLOduration=2.088402467 podStartE2EDuration="2.088402467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:52:37.085173164 +0000 UTC m=+3303.245563558" watchObservedRunningTime="2026-07-27 21:52:37.088402467 +0000 UTC m=+3303.248792826"
Jul 27 21:52:38.072548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:38.072512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:38.073311 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:38.073289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:52:39.084027 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:39.083982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:39.189275 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:39.189248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:41.756266 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:41.756235    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:41.940451 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:41.940418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:42.215859 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:42.215819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:42.314662 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:42.314636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:43.580309 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:43.580278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:44.685970 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:44.685934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:52:50.763157 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:50.763124    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:52:59.203200 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:59.203132    2579 generic.go:356] "Generic (PLEG): container finished" podID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerID="9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde" exitCode=0
Jul 27 21:52:59.203577 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:59.203219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" event={"ID":"692af447-c3f3-49e2-99f5-660f7ad02ec2","Type":"ContainerDied","Data":"9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde"}
Jul 27 21:52:59.203640 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:59.203579    2579 scope.go:117] "RemoveContainer" containerID="9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde"
Jul 27 21:52:59.204657 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:59.204633    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:52:59.204728 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:59.204696    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:52:59.204777 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:52:59.204731    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:53:00.215514 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:00.215468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" event={"ID":"692af447-c3f3-49e2-99f5-660f7ad02ec2","Type":"ContainerStarted","Data":"ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384"}
Jul 27 21:53:01.067539 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:01.067498    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:53:01.067786 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:01.067721    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 21:53:01.067873 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:01.067809    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 21:53:02.067413 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:02.067380    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 21:53:02.067889 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:02.067430    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 21:53:03.067583 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:03.067546    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 21:53:03.067983 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:03.067631    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 21:53:04.066846 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:04.066811    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 21:53:04.067012 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:04.066875    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 21:53:05.071180 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:05.071153    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:53:05.071545 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:05.071420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:53:05.072190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:05.072174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:53:08.639706 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:08.639677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:08.740215 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:08.740179    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:08.801722 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:08.801688    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:09.188947 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:09.188920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:14.054800 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:14.054766    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:53:15.331519 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:15.331486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:15.429559 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:15.429528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:15.617138 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:15.617062    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"]
Jul 27 21:53:15.617302 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:15.617277    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy" containerID="cri-o://ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384" gracePeriod=30
Jul 27 21:53:15.643414 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:15.643387    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:15.902979 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:15.902899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:20.074059 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.074020    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:53:20.074507 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.074095    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:53:20.877804 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.877753    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:53:20.999506 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999482    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-data\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999695 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999530    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-podinfo\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999695 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-token\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999695 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999630    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-credential-socket\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999717    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/692af447-c3f3-49e2-99f5-660f7ad02ec2-istiod-ca-cert\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-socket\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-certs\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999824    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwncq\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-kube-api-access-zwncq\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:20.999870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999849    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-envoy\") pod \"692af447-c3f3-49e2-99f5-660f7ad02ec2\" (UID: \"692af447-c3f3-49e2-99f5-660f7ad02ec2\") "
Jul 27 21:53:21.000111 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:20.999911    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:53:21.000164 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.000142    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:53:21.000225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.000160    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/692af447-c3f3-49e2-99f5-660f7ad02ec2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:53:21.000225 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.000198    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.000322 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.000285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:53:21.000621 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.000575    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-data" (OuterVolumeSpecName: "istio-data") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:53:21.002039 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.002017    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-token" (OuterVolumeSpecName: "istio-token") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:53:21.002213 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.002196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-kube-api-access-zwncq" (OuterVolumeSpecName: "kube-api-access-zwncq") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "kube-api-access-zwncq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:53:21.002399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.002370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:53:21.002399 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.002397    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "692af447-c3f3-49e2-99f5-660f7ad02ec2" (UID: "692af447-c3f3-49e2-99f5-660f7ad02ec2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:53:21.101127 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101103    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.101127 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101124    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.101442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101132    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.101442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101140    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/692af447-c3f3-49e2-99f5-660f7ad02ec2-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.101442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101149    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.101442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101157    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.101442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101173    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwncq\" (UniqueName: \"kubernetes.io/projected/692af447-c3f3-49e2-99f5-660f7ad02ec2-kube-api-access-zwncq\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.101442 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.101181    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/692af447-c3f3-49e2-99f5-660f7ad02ec2-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:53:21.351212 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.351182    2579 generic.go:356] "Generic (PLEG): container finished" podID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerID="ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384" exitCode=0
Jul 27 21:53:21.351341 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.351226    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"
Jul 27 21:53:21.351341 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.351273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" event={"ID":"692af447-c3f3-49e2-99f5-660f7ad02ec2","Type":"ContainerDied","Data":"ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384"}
Jul 27 21:53:21.351341 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.351325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs" event={"ID":"692af447-c3f3-49e2-99f5-660f7ad02ec2","Type":"ContainerDied","Data":"56668fc7062e810c51c1a88668dc624426591ddb3292db093a27c73c60a99faa"}
Jul 27 21:53:21.351471 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.351351    2579 scope.go:117] "RemoveContainer" containerID="ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384"
Jul 27 21:53:21.361814 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.361796    2579 scope.go:117] "RemoveContainer" containerID="9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde"
Jul 27 21:53:21.371385 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.371365    2579 scope.go:117] "RemoveContainer" containerID="ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384"
Jul 27 21:53:21.371731 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:53:21.371710    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384\": container with ID starting with ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384 not found: ID does not exist" containerID="ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384"
Jul 27 21:53:21.371819 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.371743    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384"} err="failed to get container status \"ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384\": rpc error: code = NotFound desc = could not find container \"ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384\": container with ID starting with ad3ff0e37c17a06ec08f2fa392b8bfc4ddd1366f6bcd32ff1ebaa30bad533384 not found: ID does not exist"
Jul 27 21:53:21.371819 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.371767    2579 scope.go:117] "RemoveContainer" containerID="9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde"
Jul 27 21:53:21.372066 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:53:21.372045    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde\": container with ID starting with 9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde not found: ID does not exist" containerID="9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde"
Jul 27 21:53:21.372112 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.372073    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde"} err="failed to get container status \"9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde\": rpc error: code = NotFound desc = could not find container \"9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde\": container with ID starting with 9cf8e0eb37d07e4ef26fc32dd6082153752e2aaafc28004d28609dd48a33adde not found: ID does not exist"
Jul 27 21:53:21.373780 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.373763    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"]
Jul 27 21:53:21.379336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:21.379316    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad54ee-openshift-default-6c4bb9bd56-99nbs"]
Jul 27 21:53:22.389137 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:22.389103    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" path="/var/lib/kubelet/pods/692af447-c3f3-49e2-99f5-660f7ad02ec2/volumes"
Jul 27 21:53:36.951380 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:36.951344    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:53:40.567119 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:40.567090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:40.657309 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:40.657278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:40.723278 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:40.723247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:40.973702 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:40.973593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:41.322750 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:41.322724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:46.360203 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:46.360167    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:53:52.155312 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:53:52.155275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:54:22.932161 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:22.932129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:23.718875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:23.718843    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:29.553875 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:29.553837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:35.657669 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:35.657634    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:35.761055 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:35.761021    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:35.940664 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:35.940563    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"]
Jul 27 21:54:35.940870 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:35.940846    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy" containerID="cri-o://6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27" gracePeriod=30
Jul 27 21:54:35.970078 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:35.970057    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:36.234868 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:36.234783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:41.193262 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.193242    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:54:41.354117 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354083    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09914423-a7c8-4ea4-b1b7-49efeb260143-istiod-ca-cert\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354117 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354124    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-certs\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-token\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-socket\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-data\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354303    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4ppn\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-kube-api-access-r4ppn\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354349 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354329    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-podinfo\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-credential-socket\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-envoy\") pod \"09914423-a7c8-4ea4-b1b7-49efeb260143\" (UID: \"09914423-a7c8-4ea4-b1b7-49efeb260143\") "
Jul 27 21:54:41.354655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354501    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:54:41.354655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354519    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:54:41.354929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354741    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:54:41.354929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354837    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09914423-a7c8-4ea4-b1b7-49efeb260143-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:54:41.354929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354899    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.354929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354916    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.354929 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.354930    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.355427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.355396    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-data" (OuterVolumeSpecName: "istio-data") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:54:41.356567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.356537    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-token" (OuterVolumeSpecName: "istio-token") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:54:41.356567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.356551    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:54:41.356763 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.356661    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:54:41.356813 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.356754    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-kube-api-access-r4ppn" (OuterVolumeSpecName: "kube-api-access-r4ppn") pod "09914423-a7c8-4ea4-b1b7-49efeb260143" (UID: "09914423-a7c8-4ea4-b1b7-49efeb260143"). InnerVolumeSpecName "kube-api-access-r4ppn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:54:41.455520 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.455495    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.455520 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.455518    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09914423-a7c8-4ea4-b1b7-49efeb260143-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.455682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.455527    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.455682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.455535    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.455682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.455544    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4ppn\" (UniqueName: \"kubernetes.io/projected/09914423-a7c8-4ea4-b1b7-49efeb260143-kube-api-access-r4ppn\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.455682 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.455554    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09914423-a7c8-4ea4-b1b7-49efeb260143-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:54:41.833673 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.833636    2579 generic.go:356] "Generic (PLEG): container finished" podID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerID="6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27" exitCode=0
Jul 27 21:54:41.833845 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.833694    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"
Jul 27 21:54:41.833845 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.833721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" event={"ID":"09914423-a7c8-4ea4-b1b7-49efeb260143","Type":"ContainerDied","Data":"6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27"}
Jul 27 21:54:41.833845 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.833797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb" event={"ID":"09914423-a7c8-4ea4-b1b7-49efeb260143","Type":"ContainerDied","Data":"e4d28d13c20db74c643203f5e87b2b4dc653f7e26972462f34a1438db1d22d5c"}
Jul 27 21:54:41.833845 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.833820    2579 scope.go:117] "RemoveContainer" containerID="6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27"
Jul 27 21:54:41.844126 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.844108    2579 scope.go:117] "RemoveContainer" containerID="694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659"
Jul 27 21:54:41.852432 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.852415    2579 scope.go:117] "RemoveContainer" containerID="6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27"
Jul 27 21:54:41.852718 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:54:41.852697    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27\": container with ID starting with 6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27 not found: ID does not exist" containerID="6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27"
Jul 27 21:54:41.852816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.852726    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27"} err="failed to get container status \"6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27\": rpc error: code = NotFound desc = could not find container \"6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27\": container with ID starting with 6d96dbef8c4565fa47c97b787d90ce31f128c8f17e951baa53b03f473068ba27 not found: ID does not exist"
Jul 27 21:54:41.852816 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.852744    2579 scope.go:117] "RemoveContainer" containerID="694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659"
Jul 27 21:54:41.853010 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:54:41.852992    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659\": container with ID starting with 694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659 not found: ID does not exist" containerID="694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659"
Jul 27 21:54:41.853075 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.853025    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659"} err="failed to get container status \"694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659\": rpc error: code = NotFound desc = could not find container \"694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659\": container with ID starting with 694569c7b492c2154b18d229cbc19f02db36788742d5efb5d86503f4c9ad7659 not found: ID does not exist"
Jul 27 21:54:41.869065 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.869039    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"]
Jul 27 21:54:41.874340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:41.874321    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-262475-openshift-default-655d4d4566-tjvjb"]
Jul 27 21:54:42.391533 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:42.391501    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" path="/var/lib/kubelet/pods/09914423-a7c8-4ea4-b1b7-49efeb260143/volumes"
Jul 27 21:54:47.882698 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:47.882642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:47.980963 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:47.980934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:48.063059 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:48.063011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:48.150887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:48.150801    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:48.537098 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:48.537067    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:51.061915 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:51.061881    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:54:55.933020 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:55.932978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:56.087340 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:56.087309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:56.305154 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:56.305122    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"]
Jul 27 21:54:56.305358 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:56.305334    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy" containerID="cri-o://b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee" gracePeriod=30
Jul 27 21:54:56.445123 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:56.445093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:56.626950 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:56.626870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:58.539171 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:58.539139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:58.620124 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:58.620092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:59.494566 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:59.494533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:59.585480 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:59.585440    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:54:59.585864 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:54:59.585504    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:55:01.558655 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.558631    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:55:01.625240 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625153    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istiod-ca-cert\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625240 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625199    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp6nn\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-kube-api-access-sp6nn\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625240 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625224    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-podinfo\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625251    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-data\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-token\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-credential-socket\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625382    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-certs\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625403    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-envoy\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625546 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625453    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-socket\") pod \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\" (UID: \"12fa9d22-7c5f-4538-bf24-465fcb1b282f\") "
Jul 27 21:55:01.625879 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625557    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:01.625879 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:01.625879 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:01.626025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625919    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.626025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:01.626025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625941    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.626025 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.625954    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.626808 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.626780    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-data" (OuterVolumeSpecName: "istio-data") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:01.627701 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.627668    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:55:01.627830 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.627804    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-kube-api-access-sp6nn" (OuterVolumeSpecName: "kube-api-access-sp6nn") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "kube-api-access-sp6nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:01.628199 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.628182    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:01.628251 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.628202    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-token" (OuterVolumeSpecName: "istio-token") pod "12fa9d22-7c5f-4538-bf24-465fcb1b282f" (UID: "12fa9d22-7c5f-4538-bf24-465fcb1b282f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:01.727455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.727419    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.727455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.727450    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp6nn\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-kube-api-access-sp6nn\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.727455 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.727462    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.727741 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.727471    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.727741 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.727479    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.727741 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.727486    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa9d22-7c5f-4538-bf24-465fcb1b282f-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:01.952319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.952232    2579 generic.go:356] "Generic (PLEG): container finished" podID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerID="b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee" exitCode=0
Jul 27 21:55:01.952319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.952280    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"
Jul 27 21:55:01.952562 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.952330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" event={"ID":"12fa9d22-7c5f-4538-bf24-465fcb1b282f","Type":"ContainerDied","Data":"b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee"}
Jul 27 21:55:01.952562 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.952422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567" event={"ID":"12fa9d22-7c5f-4538-bf24-465fcb1b282f","Type":"ContainerDied","Data":"a51cdb7891427ec1b243a3d03ccf90c188a31adc2e39147d4bff4cffea2e0111"}
Jul 27 21:55:01.952562 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.952456    2579 scope.go:117] "RemoveContainer" containerID="b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee"
Jul 27 21:55:01.962577 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.962561    2579 scope.go:117] "RemoveContainer" containerID="fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9"
Jul 27 21:55:01.974015 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.973994    2579 scope.go:117] "RemoveContainer" containerID="b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee"
Jul 27 21:55:01.974375 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:55:01.974352    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee\": container with ID starting with b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee not found: ID does not exist" containerID="b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee"
Jul 27 21:55:01.974491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.974383    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee"} err="failed to get container status \"b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee\": rpc error: code = NotFound desc = could not find container \"b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee\": container with ID starting with b88312273fc1b78dcf6d64e3139cadf63d3ad1e2cc6b54ef41a50a8ae912e6ee not found: ID does not exist"
Jul 27 21:55:01.974491 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.974417    2579 scope.go:117] "RemoveContainer" containerID="fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9"
Jul 27 21:55:01.974859 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:55:01.974831    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9\": container with ID starting with fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9 not found: ID does not exist" containerID="fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9"
Jul 27 21:55:01.974959 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.974868    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9"} err="failed to get container status \"fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9\": rpc error: code = NotFound desc = could not find container \"fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9\": container with ID starting with fcb105de104f10abc2a9f0c8080a817477f0c8ee6a3556e857c87dcba1fc86b9 not found: ID does not exist"
Jul 27 21:55:01.977982 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.977959    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"]
Jul 27 21:55:01.987045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:01.987016    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-c3af52-openshift-default-86d4bb74d-k7567"]
Jul 27 21:55:02.389956 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:02.389926    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" path="/var/lib/kubelet/pods/12fa9d22-7c5f-4538-bf24-465fcb1b282f/volumes"
Jul 27 21:55:08.674506 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:08.674469    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:08.682945 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:08.682909    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"]
Jul 27 21:55:08.690031 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:08.689989    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3298cd-29753145-stbvl"]
Jul 27 21:55:08.755310 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:08.755271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:08.825583 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:08.825546    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:08.925045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:08.924956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:09.384737 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:09.384689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:10.389658 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:10.389592    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff81b0b1-81c6-4b96-bdd8-8b30c382038a" path="/var/lib/kubelet/pods/ff81b0b1-81c6-4b96-bdd8-8b30c382038a/volumes"
Jul 27 21:55:11.654918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:11.654884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:55:16.226339 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:16.226290    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:16.325622 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:16.325572    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:16.560402 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:16.560369    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"]
Jul 27 21:55:16.560676 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:16.560650    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy" containerID="cri-o://2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c" gracePeriod=30
Jul 27 21:55:16.611901 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:16.611858    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:16.828013 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:16.827903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:21.819181 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.819122    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:55:21.915022 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.914992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-socket\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915039    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-data\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-certs\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915086    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-envoy\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915111    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-credential-socket\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915138    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-podinfo\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915174    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee115319-e150-4c54-8019-d40b59cb3a3c-istiod-ca-cert\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-token\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915242    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwndg\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-kube-api-access-jwndg\") pod \"ee115319-e150-4c54-8019-d40b59cb3a3c\" (UID: \"ee115319-e150-4c54-8019-d40b59cb3a3c\") "
Jul 27 21:55:21.915581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915282    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:21.915581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:21.915581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915532    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:21.915767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915636    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:21.915767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915655    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:21.915767 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.915656    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee115319-e150-4c54-8019-d40b59cb3a3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:21.916302 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.916271    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:21.917496 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.917465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:21.917635 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.917575    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:21.917635 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.917614    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:55:21.917635 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:21.917623    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-kube-api-access-jwndg" (OuterVolumeSpecName: "kube-api-access-jwndg") pod "ee115319-e150-4c54-8019-d40b59cb3a3c" (UID: "ee115319-e150-4c54-8019-d40b59cb3a3c"). InnerVolumeSpecName "kube-api-access-jwndg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:22.016839 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.016808    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:22.016839 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.016833    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:22.016839 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.016843    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee115319-e150-4c54-8019-d40b59cb3a3c-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:22.017060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.016852    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:22.017060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.016861    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee115319-e150-4c54-8019-d40b59cb3a3c-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:22.017060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.016868    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:22.017060 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.016877    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwndg\" (UniqueName: \"kubernetes.io/projected/ee115319-e150-4c54-8019-d40b59cb3a3c-kube-api-access-jwndg\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:22.078257 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.078177    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerID="2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c" exitCode=0
Jul 27 21:55:22.078257 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.078233    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"
Jul 27 21:55:22.078422 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.078261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" event={"ID":"ee115319-e150-4c54-8019-d40b59cb3a3c","Type":"ContainerDied","Data":"2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c"}
Jul 27 21:55:22.078422 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.078314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx" event={"ID":"ee115319-e150-4c54-8019-d40b59cb3a3c","Type":"ContainerDied","Data":"7a7f4a998d6fc571174f3102e0545bab178dc7ac8eb6df3c9440b662fc6b06c7"}
Jul 27 21:55:22.078422 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.078338    2579 scope.go:117] "RemoveContainer" containerID="2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c"
Jul 27 21:55:22.088336 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.088320    2579 scope.go:117] "RemoveContainer" containerID="d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc"
Jul 27 21:55:22.097026 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.097010    2579 scope.go:117] "RemoveContainer" containerID="2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c"
Jul 27 21:55:22.097287 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:55:22.097271    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c\": container with ID starting with 2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c not found: ID does not exist" containerID="2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c"
Jul 27 21:55:22.097333 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.097294    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c"} err="failed to get container status \"2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c\": rpc error: code = NotFound desc = could not find container \"2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c\": container with ID starting with 2118ef41dccecce5100d43cfd35cd210c22b64a61967266eb0bdc1cd503de39c not found: ID does not exist"
Jul 27 21:55:22.097333 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.097310    2579 scope.go:117] "RemoveContainer" containerID="d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc"
Jul 27 21:55:22.097562 ip-10-0-143-7 kubenswrapper[2579]: E0727 21:55:22.097545    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc\": container with ID starting with d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc not found: ID does not exist" containerID="d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc"
Jul 27 21:55:22.097641 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.097567    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc"} err="failed to get container status \"d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc\": rpc error: code = NotFound desc = could not find container \"d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc\": container with ID starting with d3f93a975010645ee7c4ddca50c6acd15a33abae264996d99d8ff869d8460ddc not found: ID does not exist"
Jul 27 21:55:22.114773 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.114744    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"]
Jul 27 21:55:22.121239 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.121215    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3298cd-openshift-default-5875fdd664-l6sgx"]
Jul 27 21:55:22.390203 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:22.390118    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" path="/var/lib/kubelet/pods/ee115319-e150-4c54-8019-d40b59cb3a3c/volumes"
Jul 27 21:55:28.133164 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.133109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:28.153473 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.153439    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"]
Jul 27 21:55:28.173827 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.173796    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-2cf6fc-29753145-knhs4"]
Jul 27 21:55:28.318983 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.318945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:28.389941 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.389843    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3533dea-598e-4257-9dca-5ee142d4d805" path="/var/lib/kubelet/pods/c3533dea-598e-4257-9dca-5ee142d4d805/volumes"
Jul 27 21:55:28.408285 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.408253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:28.477419 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.477384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:28.873954 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:28.873916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:30.958163 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:30.958106    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t82x4"]
Jul 27 21:55:34.674416 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:34.674374    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:34.734435 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:34.734400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:34.944506 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:34.944391    2579 scope.go:117] "RemoveContainer" containerID="67084b25d1886eadcfebc5f1a6e51f8419a239205910f0f677a42e263350f1ff"
Jul 27 21:55:34.959746 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:34.959709    2579 scope.go:117] "RemoveContainer" containerID="f2a90ed5afeeba15cd5ea94bd28f32f278832988ba299702108fa85475158060"
Jul 27 21:55:34.965255 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:34.965219    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"]
Jul 27 21:55:34.965550 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:34.965522    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy" containerID="cri-o://7f9be25d276f23f0308a83d236c25f21ef8b3e861a477bf6ab1c6637b0e6ba32" gracePeriod=30
Jul 27 21:55:34.988192 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:34.988163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:35.226449 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:35.226361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:40.195463 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.195425    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0ba8387-a823-4778-9938-79e25f254f61" containerID="7f9be25d276f23f0308a83d236c25f21ef8b3e861a477bf6ab1c6637b0e6ba32" exitCode=0
Jul 27 21:55:40.195977 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.195501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" event={"ID":"d0ba8387-a823-4778-9938-79e25f254f61","Type":"ContainerDied","Data":"7f9be25d276f23f0308a83d236c25f21ef8b3e861a477bf6ab1c6637b0e6ba32"}
Jul 27 21:55:40.195977 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.195616    2579 scope.go:117] "RemoveContainer" containerID="96b490f833a70d1d1ab4b62ab7ba4f59b18e83a1d1e1226e29cd471b48cc74a4"
Jul 27 21:55:40.222938 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.222914    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:55:40.295510 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295472    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-credential-socket\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.295510 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295514    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0ba8387-a823-4778-9938-79e25f254f61-istiod-ca-cert\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.295824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-certs\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.295824 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295757    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-envoy\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.295933 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295857    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-socket\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.295933 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295894    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-data\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.295933 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:40.296084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v8qz\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-kube-api-access-9v8qz\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.296084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295981    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-istio-token\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.296084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295870    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:40.296084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.295941    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ba8387-a823-4778-9938-79e25f254f61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:40.296084 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.296008    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0ba8387-a823-4778-9938-79e25f254f61-istio-podinfo\") pod \"d0ba8387-a823-4778-9938-79e25f254f61\" (UID: \"d0ba8387-a823-4778-9938-79e25f254f61\") "
Jul 27 21:55:40.296354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.296073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:40.296354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.296320    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.296354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.296340    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0ba8387-a823-4778-9938-79e25f254f61-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.296476 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.296359    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.296476 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.296376    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.297096 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.297068    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:40.298289 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.298266    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:55:40.298393 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.298370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:40.298705 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.298679    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0ba8387-a823-4778-9938-79e25f254f61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:55:40.298705 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.298677    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-kube-api-access-9v8qz" (OuterVolumeSpecName: "kube-api-access-9v8qz") pod "d0ba8387-a823-4778-9938-79e25f254f61" (UID: "d0ba8387-a823-4778-9938-79e25f254f61"). InnerVolumeSpecName "kube-api-access-9v8qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:40.324919 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.324877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:40.396999 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.396969    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.396999 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.396997    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0ba8387-a823-4778-9938-79e25f254f61-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.397209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.397011    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.397209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.397021    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0ba8387-a823-4778-9938-79e25f254f61-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:40.397209 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:40.397032    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v8qz\" (UniqueName: \"kubernetes.io/projected/d0ba8387-a823-4778-9938-79e25f254f61-kube-api-access-9v8qz\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 27 21:55:41.203560 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:41.203526    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"
Jul 27 21:55:41.204045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:41.203568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s" event={"ID":"d0ba8387-a823-4778-9938-79e25f254f61","Type":"ContainerDied","Data":"b2a2cec521ca8c1d9941c299aa1670da0e6c3e0046de019df22f743462eee8a9"}
Jul 27 21:55:41.204045 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:41.203652    2579 scope.go:117] "RemoveContainer" containerID="7f9be25d276f23f0308a83d236c25f21ef8b3e861a477bf6ab1c6637b0e6ba32"
Jul 27 21:55:41.244731 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:41.244686    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"]
Jul 27 21:55:41.252891 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:41.252848    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2cf6fc-openshift-default-5cd4b478bd-58r9s"]
Jul 27 21:55:42.390326 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:42.390280    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0ba8387-a823-4778-9938-79e25f254f61" path="/var/lib/kubelet/pods/d0ba8387-a823-4778-9938-79e25f254f61/volumes"
Jul 27 21:55:42.474865 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:42.474836    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-vxk89_c5e81bf2-50e2-4922-b337-7873cb6fa907/copy-manifests/0.log"
Jul 27 21:55:42.489831 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:42.489798    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-vxk89_c5e81bf2-50e2-4922-b337-7873cb6fa907/manager/0.log"
Jul 27 21:55:42.995427 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:42.995400    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753115-drdcl_bf762903-ceee-456f-af91-df4ee989f57c/cleanup/0.log"
Jul 27 21:55:43.122307 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:43.122280    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753130-gdns5_69989e67-aaec-4d59-9aca-f347fe1ff33e/cleanup/0.log"
Jul 27 21:55:43.241826 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:43.241796    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753145-g85fp_b2e8c617-0d7f-43eb-b8c6-2492456b4c19/cleanup/0.log"
Jul 27 21:55:44.202395 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.202362    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg_a8793dcb-2bbd-4081-968d-33373ba6e839/util/0.log"
Jul 27 21:55:44.210354 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.210323    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg_a8793dcb-2bbd-4081-968d-33373ba6e839/pull/0.log"
Jul 27 21:55:44.217928 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.217899    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg_a8793dcb-2bbd-4081-968d-33373ba6e839/extract/0.log"
Jul 27 21:55:44.335871 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.335839    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d_6b57081e-f576-4d2c-83d4-a2c880abfa83/util/0.log"
Jul 27 21:55:44.343752 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.343732    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d_6b57081e-f576-4d2c-83d4-a2c880abfa83/pull/0.log"
Jul 27 21:55:44.351274 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.351251    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d_6b57081e-f576-4d2c-83d4-a2c880abfa83/extract/0.log"
Jul 27 21:55:44.475112 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.475023    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw_4c6d9379-020d-4568-8285-ccd4e64d7f23/util/0.log"
Jul 27 21:55:44.482136 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.482100    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw_4c6d9379-020d-4568-8285-ccd4e64d7f23/pull/0.log"
Jul 27 21:55:44.488966 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.488939    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw_4c6d9379-020d-4568-8285-ccd4e64d7f23/extract/0.log"
Jul 27 21:55:44.612042 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.611998    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc_93869c16-e3ab-4f23-aa26-25e99de5e5d4/extract/0.log"
Jul 27 21:55:44.619494 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.619466    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc_93869c16-e3ab-4f23-aa26-25e99de5e5d4/util/0.log"
Jul 27 21:55:44.626643 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:44.626615    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc_93869c16-e3ab-4f23-aa26-25e99de5e5d4/pull/0.log"
Jul 27 21:55:45.495797 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:45.495764    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t82x4_9f382f80-42f9-435c-b806-d87bdcb0b997/limitador/0.log"
Jul 27 21:55:46.128646 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:46.128589    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s8ml7_1fc5c72d-dfb4-40b9-9473-84fa37c6e85b/discovery/0.log"
Jul 27 21:55:46.884260 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:46.884227    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-954df59-z652s_34e15980-9da6-4ede-b1b1-99fc74e4b99d/router/0.log"
Jul 27 21:55:47.418917 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:47.418884    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-l4cx8_2f5105ca-eda3-4936-96cb-6dc54d0e04f2/main/0.log"
Jul 27 21:55:53.800591 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:53.800540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:54.959406 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:54.959304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:56.735282 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:56.735249    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g6r5w_2fc4a764-fc39-467f-8bcd-cd0306e92175/global-pull-secret-syncer/0.log"
Jul 27 21:55:56.784876 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:56.784845    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4vsdl_4eedc323-ed18-4caa-a678-cd72443230bb/konnectivity-agent/0.log"
Jul 27 21:55:56.930319 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:55:56.930276    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-7.ec2.internal_e96ac081a13f35be7d7732312e8932bb/haproxy/0.log"
Jul 27 21:56:01.468066 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.468034    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg_a8793dcb-2bbd-4081-968d-33373ba6e839/extract/0.log"
Jul 27 21:56:01.496842 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.496814    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg_a8793dcb-2bbd-4081-968d-33373ba6e839/util/0.log"
Jul 27 21:56:01.516918 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.516890    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkhbg_a8793dcb-2bbd-4081-968d-33373ba6e839/pull/0.log"
Jul 27 21:56:01.553933 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.553905    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d_6b57081e-f576-4d2c-83d4-a2c880abfa83/extract/0.log"
Jul 27 21:56:01.579761 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.579734    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d_6b57081e-f576-4d2c-83d4-a2c880abfa83/util/0.log"
Jul 27 21:56:01.605303 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.605250    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xw74d_6b57081e-f576-4d2c-83d4-a2c880abfa83/pull/0.log"
Jul 27 21:56:01.638594 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.638565    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw_4c6d9379-020d-4568-8285-ccd4e64d7f23/extract/0.log"
Jul 27 21:56:01.665742 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.665718    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw_4c6d9379-020d-4568-8285-ccd4e64d7f23/util/0.log"
Jul 27 21:56:01.691734 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.691705    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rmsxw_4c6d9379-020d-4568-8285-ccd4e64d7f23/pull/0.log"
Jul 27 21:56:01.721229 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.721140    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc_93869c16-e3ab-4f23-aa26-25e99de5e5d4/extract/0.log"
Jul 27 21:56:01.749905 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.749866    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc_93869c16-e3ab-4f23-aa26-25e99de5e5d4/util/0.log"
Jul 27 21:56:01.781064 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:01.781039    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxzqc_93869c16-e3ab-4f23-aa26-25e99de5e5d4/pull/0.log"
Jul 27 21:56:02.645691 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:02.645664    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t82x4_9f382f80-42f9-435c-b806-d87bdcb0b997/limitador/0.log"
Jul 27 21:56:04.406722 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.406685    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1161446-43c4-4c64-9bb7-d7b10187a816/alertmanager/0.log"
Jul 27 21:56:04.430529 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.430504    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1161446-43c4-4c64-9bb7-d7b10187a816/config-reloader/0.log"
Jul 27 21:56:04.453836 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.453810    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1161446-43c4-4c64-9bb7-d7b10187a816/kube-rbac-proxy-web/0.log"
Jul 27 21:56:04.483820 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.483799    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1161446-43c4-4c64-9bb7-d7b10187a816/kube-rbac-proxy/0.log"
Jul 27 21:56:04.507958 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.507928    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1161446-43c4-4c64-9bb7-d7b10187a816/kube-rbac-proxy-metric/0.log"
Jul 27 21:56:04.537269 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.537239    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1161446-43c4-4c64-9bb7-d7b10187a816/prom-label-proxy/0.log"
Jul 27 21:56:04.560190 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.560165    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1161446-43c4-4c64-9bb7-d7b10187a816/init-config-reloader/0.log"
Jul 27 21:56:04.603170 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.603131    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-c9mdk_66d08f71-7f5e-4bcc-b7c0-63d1a2f23d5a/cluster-monitoring-operator/0.log"
Jul 27 21:56:04.741378 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.741350    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-wlpb5_d82b5151-dfb1-4f53-a7a8-eda72e10383c/monitoring-plugin/0.log"
Jul 27 21:56:04.866355 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.866319    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h8q88_114cbca7-b17f-43f3-b5ae-511d7ed36947/node-exporter/0.log"
Jul 27 21:56:04.890328 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.890293    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h8q88_114cbca7-b17f-43f3-b5ae-511d7ed36947/kube-rbac-proxy/0.log"
Jul 27 21:56:04.913070 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:04.913037    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h8q88_114cbca7-b17f-43f3-b5ae-511d7ed36947/init-textfile/0.log"
Jul 27 21:56:05.027120 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.027090    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-66h4j_f698e65d-8db6-4230-9e78-42071a912fd0/kube-rbac-proxy-main/0.log"
Jul 27 21:56:05.051316 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.051288    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-66h4j_f698e65d-8db6-4230-9e78-42071a912fd0/kube-rbac-proxy-self/0.log"
Jul 27 21:56:05.074821 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.074792    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-66h4j_f698e65d-8db6-4230-9e78-42071a912fd0/openshift-state-metrics/0.log"
Jul 27 21:56:05.354671 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.354545    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698669868-tcvwl_be34041a-bf56-43f2-a923-c210f1273cef/telemeter-client/0.log"
Jul 27 21:56:05.376850 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.376823    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698669868-tcvwl_be34041a-bf56-43f2-a923-c210f1273cef/reload/0.log"
Jul 27 21:56:05.398568 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.398543    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698669868-tcvwl_be34041a-bf56-43f2-a923-c210f1273cef/kube-rbac-proxy/0.log"
Jul 27 21:56:05.432840 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.432812    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7868b8b499-pswvv_dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce/thanos-query/0.log"
Jul 27 21:56:05.453560 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.453528    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7868b8b499-pswvv_dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce/kube-rbac-proxy-web/0.log"
Jul 27 21:56:05.474526 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.474503    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7868b8b499-pswvv_dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce/kube-rbac-proxy/0.log"
Jul 27 21:56:05.494714 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.494686    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7868b8b499-pswvv_dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce/prom-label-proxy/0.log"
Jul 27 21:56:05.521006 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.520981    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7868b8b499-pswvv_dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce/kube-rbac-proxy-rules/0.log"
Jul 27 21:56:05.577322 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:05.577274    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7868b8b499-pswvv_dcdc2bb2-7855-49e0-a5aa-ff8e72faf9ce/kube-rbac-proxy-metrics/0.log"
Jul 27 21:56:06.721115 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721073    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"]
Jul 27 21:56:06.721668 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721645    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy"
Jul 27 21:56:06.721755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721671    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy"
Jul 27 21:56:06.721755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721699    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy"
Jul 27 21:56:06.721755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721709    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy"
Jul 27 21:56:06.721755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721722    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy"
Jul 27 21:56:06.721755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721732    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy"
Jul 27 21:56:06.721755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721745    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy"
Jul 27 21:56:06.721755 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721754    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721773    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721781    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721795    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721803    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721826    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721834    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721848    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721857    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721952    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721967    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fa9d22-7c5f-4538-bf24-465fcb1b282f" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721978    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="09914423-a7c8-4ea4-b1b7-49efeb260143" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721986    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="692af447-c3f3-49e2-99f5-660f7ad02ec2" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.721997    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.722005    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.722014    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee115319-e150-4c54-8019-d40b59cb3a3c" containerName="istio-proxy"
Jul 27 21:56:06.722105 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.722022    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ba8387-a823-4778-9938-79e25f254f61" containerName="istio-proxy"
Jul 27 21:56:06.725590 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.725570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.728391 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.728373    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km5v5\"/\"kube-root-ca.crt\""
Jul 27 21:56:06.729303 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.729287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-km5v5\"/\"default-dockercfg-fvx26\""
Jul 27 21:56:06.729414 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.729393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km5v5\"/\"openshift-service-ca.crt\""
Jul 27 21:56:06.738014 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.737991    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"]
Jul 27 21:56:06.783581 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.783526    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-xqd8s_8107055b-59c3-48dd-a14b-d552a4f1b290/networking-console-plugin/0.log"
Jul 27 21:56:06.854149 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.854106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-sys\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.854356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.854167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-podres\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.854356 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.854316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwp8m\" (UniqueName: \"kubernetes.io/projected/d786029f-83cd-41ae-9be9-bf3beddfba0f-kube-api-access-wwp8m\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.854433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.854370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-lib-modules\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.854433 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.854412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-proc\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955021 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.954981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-podres\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwp8m\" (UniqueName: \"kubernetes.io/projected/d786029f-83cd-41ae-9be9-bf3beddfba0f-kube-api-access-wwp8m\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-lib-modules\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-proc\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-proc\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955211 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-podres\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955426 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-sys\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955426 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-lib-modules\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.955426 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.955330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d786029f-83cd-41ae-9be9-bf3beddfba0f-sys\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:06.963839 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:06.963815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwp8m\" (UniqueName: \"kubernetes.io/projected/d786029f-83cd-41ae-9be9-bf3beddfba0f-kube-api-access-wwp8m\") pod \"perf-node-gather-daemonset-rzhzt\" (UID: \"d786029f-83cd-41ae-9be9-bf3beddfba0f\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:07.035468 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.035438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:07.178342 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.178311    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"]
Jul 27 21:56:07.180011 ip-10-0-143-7 kubenswrapper[2579]: W0727 21:56:07.179984    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd786029f_83cd_41ae_9be9_bf3beddfba0f.slice/crio-5becb3a6cdbdeb0a429001a16da2aa2b8c1e351642909d9757de261a822360e7 WatchSource:0}: Error finding container 5becb3a6cdbdeb0a429001a16da2aa2b8c1e351642909d9757de261a822360e7: Status 404 returned error can't find the container with id 5becb3a6cdbdeb0a429001a16da2aa2b8c1e351642909d9757de261a822360e7
Jul 27 21:56:07.360379 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.360338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt" event={"ID":"d786029f-83cd-41ae-9be9-bf3beddfba0f","Type":"ContainerStarted","Data":"0a4a72c8b249db1742ec0da8aac4b42bacdffb5433e5e4fb45f8a6a5936d494e"}
Jul 27 21:56:07.360574 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.360542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:07.360648 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.360583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt" event={"ID":"d786029f-83cd-41ae-9be9-bf3beddfba0f","Type":"ContainerStarted","Data":"5becb3a6cdbdeb0a429001a16da2aa2b8c1e351642909d9757de261a822360e7"}
Jul 27 21:56:07.376962 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.376911    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt" podStartSLOduration=1.376894088 podStartE2EDuration="1.376894088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:07.375947995 +0000 UTC m=+3513.536338376" watchObservedRunningTime="2026-07-27 21:56:07.376894088 +0000 UTC m=+3513.537284446"
Jul 27 21:56:07.441548 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.441488    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/1.log"
Jul 27 21:56:07.446015 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:07.445990    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vnhpt_ac707221-d7ac-48b7-bad1-cb5a56b9f3c7/console-operator/2.log"
Jul 27 21:56:08.525620 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:08.525582    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-tlt7t_b18e0dde-f8c9-488a-95ec-4bcb5afc3e69/volume-data-source-validator/0.log"
Jul 27 21:56:09.646051 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:09.646002    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfmkk_0b24c3a4-37b3-423d-ba42-d89b835c8ce4/dns/0.log"
Jul 27 21:56:09.665717 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:09.665691    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfmkk_0b24c3a4-37b3-423d-ba42-d89b835c8ce4/kube-rbac-proxy/0.log"
Jul 27 21:56:09.712961 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:09.712923    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfjn2_f855d0ec-cba7-4c2a-9986-5c5bee38a5e8/dns-node-resolver/0.log"
Jul 27 21:56:10.327967 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:10.327931    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrjxn_e9bbfe05-3cd1-4254-98de-d3e94042dd83/node-ca/0.log"
Jul 27 21:56:11.382066 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:11.382032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s8ml7_1fc5c72d-dfb4-40b9-9473-84fa37c6e85b/discovery/0.log"
Jul 27 21:56:11.581983 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:11.581945    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-954df59-z652s_34e15980-9da6-4ede-b1b1-99fc74e4b99d/router/0.log"
Jul 27 21:56:12.372567 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:12.372537    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7nbzq_d4b41cc0-36f6-4c68-b670-4f541f1b0a40/serve-healthcheck-canary/0.log"
Jul 27 21:56:12.907210 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:12.907167    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-dfvgc_0e011435-9274-419a-afec-edfa583527e7/insights-operator/0.log"
Jul 27 21:56:12.907744 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:12.907715    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-dfvgc_0e011435-9274-419a-afec-edfa583527e7/insights-operator/1.log"
Jul 27 21:56:12.929352 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:12.929330    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s2fm_7ff0c84d-356d-4f99-a31f-04576a6db132/kube-rbac-proxy/0.log"
Jul 27 21:56:12.949633 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:12.949591    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s2fm_7ff0c84d-356d-4f99-a31f-04576a6db132/exporter/0.log"
Jul 27 21:56:12.973790 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:12.973748    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s2fm_7ff0c84d-356d-4f99-a31f-04576a6db132/extractor/0.log"
Jul 27 21:56:13.378069 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:13.378038    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-rzhzt"
Jul 27 21:56:16.138439 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:16.138394    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-vxk89_c5e81bf2-50e2-4922-b337-7873cb6fa907/manager/0.log"
Jul 27 21:56:16.157355 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:16.157322    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-vxk89_c5e81bf2-50e2-4922-b337-7873cb6fa907/copy-manifests/0.log"
Jul 27 21:56:17.235315 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:17.235276    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s8ml7_1fc5c72d-dfb4-40b9-9473-84fa37c6e85b/discovery/0.log"
Jul 27 21:56:17.390059 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:17.389950    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-954df59-z652s_34e15980-9da6-4ede-b1b1-99fc74e4b99d/router/0.log"
Jul 27 21:56:17.600831 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:17.600802    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75c6cc9f98-pcc97_c6e65121-f9c9-49a4-9d93-79775f1ff793/manager/0.log"
Jul 27 21:56:18.949525 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:18.949113    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s8ml7_1fc5c72d-dfb4-40b9-9473-84fa37c6e85b/discovery/0.log"
Jul 27 21:56:19.107743 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:19.107698    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-954df59-z652s_34e15980-9da6-4ede-b1b1-99fc74e4b99d/router/0.log"
Jul 27 21:56:22.927610 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:22.927567    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t_f89e5839-37b9-4d56-993c-303eddd9550c/kube-storage-version-migrator-operator/1.log"
Jul 27 21:56:22.928008 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:22.927970    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-qb86t_f89e5839-37b9-4d56-993c-303eddd9550c/kube-storage-version-migrator-operator/0.log"
Jul 27 21:56:23.930498 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:23.930468    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4n9_de6f1fc5-b897-4ea8-9534-c388a45937d1/kube-multus-additional-cni-plugins/0.log"
Jul 27 21:56:23.953586 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:23.953555    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4n9_de6f1fc5-b897-4ea8-9534-c388a45937d1/egress-router-binary-copy/0.log"
Jul 27 21:56:23.974810 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:23.974785    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4n9_de6f1fc5-b897-4ea8-9534-c388a45937d1/cni-plugins/0.log"
Jul 27 21:56:23.997050 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:23.997022    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4n9_de6f1fc5-b897-4ea8-9534-c388a45937d1/bond-cni-plugin/0.log"
Jul 27 21:56:24.018793 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:24.018761    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4n9_de6f1fc5-b897-4ea8-9534-c388a45937d1/routeoverride-cni/0.log"
Jul 27 21:56:24.040288 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:24.040256    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4n9_de6f1fc5-b897-4ea8-9534-c388a45937d1/whereabouts-cni-bincopy/0.log"
Jul 27 21:56:24.064189 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:24.064159    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4n9_de6f1fc5-b897-4ea8-9534-c388a45937d1/whereabouts-cni/0.log"
Jul 27 21:56:24.543887 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:24.543850    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p6xmj_c2767fa3-8e6d-4382-8fd2-02d4b5a9cfe7/kube-multus/0.log"
Jul 27 21:56:24.575590 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:24.575549    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6j54f_6fecdeae-440a-44c5-a4b1-8ce9d02bf70b/network-metrics-daemon/0.log"
Jul 27 21:56:24.598799 ip-10-0-143-7 kubenswrapper[2579]: I0727 21:56:24.598770    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6j54f_6fecdeae-440a-44c5-a4b1-8ce9d02bf70b/kube-rbac-proxy/0.log"